-- Logs begin at Tue 2022-08-30 11:08:34 UTC, end at Tue 2022-08-30 12:06:15 UTC. -- Aug 30 11:35:12.426454 dv-cinder-852208-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 11:35:12.437471 dv-cinder-852208-12-smb devstack@keystone.service[93179]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 11:35:12 2022] *** Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: nodename: dv-cinder-852208-12-smb Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: machine: x86_64 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: clock source: unix Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: pcre jit disabled Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: detected number of CPU cores: 4 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: current working directory: / Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: detected binary path: /usr/bin/uwsgi-core Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: your processes number limit is 47680 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: your memory page size is 4096 bytes Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: detected max file descriptor number: 2048 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: lock engine: pthread robust mutexes Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: thunder lock: enabled Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 11:35:12.438749 dv-cinder-852208-12-smb devstack@keystone.service[93179]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 11:35:12.477706 dv-cinder-852208-12-smb devstack@keystone.service[93179]: Python main interpreter initialized at 0x56529f3859c0 Aug 30 11:35:12.477706 dv-cinder-852208-12-smb devstack@keystone.service[93179]: python threads support enabled Aug 30 11:35:12.477706 dv-cinder-852208-12-smb devstack@keystone.service[93179]: your server socket listen backlog is limited to 100 connections Aug 30 11:35:12.477706 dv-cinder-852208-12-smb devstack@keystone.service[93179]: your mercy for graceful operations on workers is 90 seconds Aug 30 11:35:12.478121 dv-cinder-852208-12-smb devstack@keystone.service[93179]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 11:35:12.478121 dv-cinder-852208-12-smb devstack@keystone.service[93179]: *** Operational MODE: preforking *** Aug 30 11:35:12.478391 dv-cinder-852208-12-smb devstack@keystone.service[93179]: *** uWSGI is running in multiple interpreter mode *** Aug 30 11:35:12.478391 dv-cinder-852208-12-smb devstack@keystone.service[93179]: spawned uWSGI master process (pid: 93179) Aug 30 11:35:12.478549 dv-cinder-852208-12-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 11:35:12.479897 dv-cinder-852208-12-smb devstack@keystone.service[93179]: spawned uWSGI worker 1 (pid: 93190, cores: 1) Aug 30 11:35:12.479897 dv-cinder-852208-12-smb devstack@keystone.service[93179]: spawned uWSGI worker 2 (pid: 93191, cores: 1) Aug 30 11:35:12.479897 dv-cinder-852208-12-smb devstack@keystone.service[93179]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 11:35:16.680249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:35:16.680249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: from cryptography.utils import int_from_bytes Aug 30 11:35:16.681244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:35:16.681244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: from cryptography.utils import int_from_bytes Aug 30 11:35:16.681666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:35:16.681666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: from cryptography.utils import int_from_bytes Aug 30 11:35:16.681773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:35:16.681773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: from cryptography.utils import int_from_bytes Aug 30 11:35:16.729895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:35:16.730098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:35:16.730262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] command line args: [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:35:16.730404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:35:16.730485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:35:16.730569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:35:16.730649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ================================================================================ {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:35:16.730725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] command line args: [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:35:16.730947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] admin_token = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:35:16.731075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ================================================================================ {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:35:16.731207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] config_dir = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] admin_token = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] config_source = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] config_dir = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] debug = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.731879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] config_source = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] debug = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.732925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_config_append = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_config_append = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_dir = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_file = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.733915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_dir = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_file = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.734932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.735879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.736956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.737933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] publish_errors = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] publish_errors = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.738819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] standard_threads = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] standard_threads = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.739940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] use_journal = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] use_json = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] use_journal = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] use_stderr = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] use_json = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.740985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] use_syslog = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.741112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] use_stderr = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.741226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.741341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] use_syslog = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.741341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:35:16.741553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.741662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.741785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.741896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.742839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743745 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.743983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.744887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.745810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.746914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.747919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.748940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.749979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.750995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.751960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.752868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.753974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.754910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.755938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756630 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.756961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.757923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.758943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.759931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.760944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.761938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.762912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.763947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.764956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.765914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.external = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.766979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.external = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.password = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] auth.token = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.password = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.767994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] auth.token = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.768915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.769893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.770913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.771924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.772953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.773943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.774967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.775961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.776933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.777922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.778922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.779942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.780953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.781892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.782902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.783931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.784939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.785898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.786910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.787925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.788936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.789887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.790462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.790586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.790699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.790811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.790923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.791949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.792860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.793945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.794958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.795987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.796888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.797929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] role.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.798892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] role.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] role.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] role.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.799903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.800926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.801909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.802999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.803887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.804762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.805988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.806972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.807927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.808937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.809980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.810903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.connection = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.811942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.connection = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.812860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.813948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.814963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:35:16.815764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:35:16.815764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:35:16.843791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.844020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.844245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.844614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.844849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.845105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.852663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.853534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.880339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.880571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.881253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.881487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.933318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.933490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.981469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.981699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.982001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:16.982224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.136468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.136771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.136861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.137898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.160950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.161938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.162010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.172708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.172837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.185761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.186894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.187011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.187089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.187205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.187320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.187320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:35:17.206732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.206893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:35:17.207278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.207402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.207572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:35:17.207678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:35:17.207802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.207881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.207977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.208063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:35:17.208294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.208537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.208665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.208841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.208927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.209053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.218397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.218678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.218954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.219077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.219214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.219313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.219500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.219777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.226225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.226691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.229232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.229525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.229812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.229934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.230065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230630 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.230907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.231844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.232001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.232091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.232297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.232563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.254468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.255250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.255923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.256212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.256710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.257070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.260910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.261227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.261517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.261812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.262061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.262452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.267762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.268054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.268713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.269002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.272097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.272395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.272681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.272900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.273045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.273905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.274220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.274344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.276356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.276650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.276940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.291158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.291445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.292398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.292679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.295296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.296545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.298509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.298816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.299642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.299937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.303008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.304233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.306228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.307678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.309449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.309757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.310050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.310342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.310632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.310755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.310912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.311048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.311322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.311610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.311897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.312281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.326596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.326881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.327148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.327417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.328158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.328450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.328724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.328998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.334558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.335997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.336165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.337920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.338044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.338181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.339517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.339796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.340795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.341113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.341512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.341802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.342095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.342461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.342724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.343020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.343311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.343602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.353264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.353555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.353938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.354228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.354518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.354818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.355053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.355186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.355380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.355634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.355918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.356194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.356484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.356783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.370382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.372307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.373264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.375335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.376083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.377570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.378212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.379178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.379475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.379640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.379735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.381154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.381455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.381754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.386267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.387805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.388479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.389992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.390731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.391032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.391325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.391606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.392841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.393163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.393450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.393734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.399463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.399761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.400045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.401908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.402201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.402488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.406908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.407197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.407484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.407764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.408043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.408330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.408612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.408896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.409208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.409333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:35:17.409473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.409561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.409781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.409922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.410905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.411189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.411470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.411753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.412026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.412290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.412555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.412831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:35:17.444340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56529f3859c0 pid: 93191 (default app) Aug 30 11:35:17.447079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56529f3859c0 pid: 93190 (default app) Aug 30 11:35:17.447797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecd835-4014-4555-8e3c-afd61dc8622a None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:17.448088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecd835-4014-4555-8e3c-afd61dc8622a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:17.448362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecd835-4014-4555-8e3c-afd61dc8622a None None] PATH_INFO: `/v3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:17.452606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Tue Aug 30 11:35:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:24.078651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:24.079219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:24.079303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:24.084037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:24.090165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:24.090686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:24.090686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:24.162354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: INFO dbcounter [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] Registered counter for database keystone Aug 30 11:35:24.182961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG oslo_db.sqlalchemy.engines [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:35:24.190232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writer thread running {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:35:24.381991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG passlib.handlers.bcrypt [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93191) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 11:35:24.382271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG passlib.handlers.bcrypt [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93191) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 11:35:24.441820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:24.443428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:24.579979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 11:35:24.917372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:24.987191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: INFO dbcounter [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] Registered counter for database keystone Aug 30 11:35:25.012081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG oslo_db.sqlalchemy.engines [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:35:25.020058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writer thread running {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:35:25.140266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fed6-abf9-47af-8343-2bbc22b21f88 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:25.149697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:25.150632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:25.151024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:25.151403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:25.165761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:25.217826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 11:35:25.218101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944bc60-7422-4953-89db-7c285493d7a1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:25.228788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Aug 30 11:35:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 11:35:25.235866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:25.259416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42c16-5d07-4aca-903a-07cbe759debe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:25.265124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:25.266235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:25.266512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:25.266792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] PATH_INFO: `/v3/projects/3b3b177b7bdd47fbbe8d53653a263794` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:25.268363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] RBAC: Authorizing `identity:get_project(project_id=3b3b177b7bdd47fbbe8d53653a263794)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:25.320919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 11:35:25.321282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224129-ba45-442d-a5b8-9e2308ee4b7d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:25.325834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Tue Aug 30 11:35:25 2022] GET /identity/v3/projects/3b3b177b7bdd47fbbe8d53653a263794 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:27.174648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8e850-8346-4fd0-9a79-7439f469ef44 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:27.175214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8e850-8346-4fd0-9a79-7439f469ef44 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:27.175214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8e850-8346-4fd0-9a79-7439f469ef44 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:27.179301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:27.186003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:27.186430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:27.186567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:27.218226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:27.219744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:27.229545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 11:35:27.491949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8e850-8346-4fd0-9a79-7439f469ef44 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:27.511376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8e850-8346-4fd0-9a79-7439f469ef44 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:27.516432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:27.517069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:27.517347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:27.517620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:27.526048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:27.527853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a5b3-93b9-4b32-84b0-bbadd8bfa1c3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:27.536893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Aug 30 11:35:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:35:27.543494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:27.558029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3464e5-d05e-475a-8d25-03a4c117f1ab None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:27.564787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:27.565461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:27.565738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:27.566005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:27.567538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:27.569399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc50b9-98d6-4a6b-99da-8bbe86ba28f7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:27.571153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Tue Aug 30 11:35:27 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:29.522396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df219ca-778e-4bad-b776-6c9615496b38 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:29.522925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df219ca-778e-4bad-b776-6c9615496b38 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:29.522925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df219ca-778e-4bad-b776-6c9615496b38 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:29.524309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:29.529989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:29.530422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:29.530506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:29.534909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cee2-236d-418c-bc05-3860e27b8006 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:29.535190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cee2-236d-418c-bc05-3860e27b8006 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:29.535460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cee2-236d-418c-bc05-3860e27b8006 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:29.536656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:29.541662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:29.541944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:29.542213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:29.549891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:29.551076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:29.585163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG passlib.handlers.bcrypt [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93190) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 11:35:29.585850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG passlib.handlers.bcrypt [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93190) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 11:35:29.634287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:29.635864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:29.635993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:29.738069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:29.900017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:29.930836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:29.998237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.020748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b7447-6915-4ac5-bc63-a56ff9402fa1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.056421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.057073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.057357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.057632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.069583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:30.078149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:30.079078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:30.080179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:30.085771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.113092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22305f9-f058-4109-8435-ef0f2d6ea98c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.116212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.150337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.151137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.151418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.151688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.168405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.186634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2a5d-6c6e-4680-9405-32cf7aee2022 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.219268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.220806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.221308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.221917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.222198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.222456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.223140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:30.223433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.224812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.236757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:30.242141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.324709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:30.330749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.335050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.344357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36f81e-3d56-4212-877b-5da5af275dc0 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.377302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.377938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.378211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.378464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.379606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.381110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.382687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:30.388737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.402947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.434487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262304f8-daf3-444c-8a25-b2a1c6e95af5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.469041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.469915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.470191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.470478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.489132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932302-beb8-48ee-a517-b2ae0b10b425 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.489285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.490767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:35:30.509546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:30.510567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:35:30.511359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:35:30.511359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:35:30.511359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:30.511359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:30.516592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.526703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.527340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.527617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.528245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.529806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.531432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.532977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:30.538816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:30.582464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.625145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:30.630419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfba5a-9b86-43d5-bb75-c578031f9780 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.646084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8659-115a-46cb-8906-a7cf4870254a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:30.664019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.664625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.665013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.665210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.665869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:30.666170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.667567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd93e0-9a46-447c-9866-440ff33c001e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.679252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:30.679911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:30.680200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:30.680474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:30.681228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.domain.id=default, user.id=362c24be2bf7418da80780e268b3a2f8) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:30.681522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:30.682959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692e307-1240-4669-bf2a-af5c0e90d472 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:30.684717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:30.689847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 11/21] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Aug 30 11:35:30 2022] GET /identity/v3/role_assignments?user.id=362c24be2bf7418da80780e268b3a2f8&scope.domain.id=default&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:32.731444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27186-6c0a-4676-b96e-d5da267f726d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:32.731967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27186-6c0a-4676-b96e-d5da267f726d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:32.731967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27186-6c0a-4676-b96e-d5da267f726d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:32.733690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:32.738810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cc947-c3ac-4da2-978f-2acbeb1f1bfc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:32.739253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cc947-c3ac-4da2-978f-2acbeb1f1bfc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:32.739327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cc947-c3ac-4da2-978f-2acbeb1f1bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:32.766977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-380cc947-c3ac-4da2-978f-2acbeb1f1bfc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:32.768187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-380cc947-c3ac-4da2-978f-2acbeb1f1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:32.864543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:33.092053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95d700-1fd2-4b6c-bf07-2c34be4973c4 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.092401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95d700-1fd2-4b6c-bf07-2c34be4973c4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.092610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95d700-1fd2-4b6c-bf07-2c34be4973c4 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.094002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:33.099573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.100124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.100617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.129687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:33.131227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:33.228468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac147f-7cc4-4f4c-b9ae-f70a63057e33 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.229121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac147f-7cc4-4f4c-b9ae-f70a63057e33 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.229737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac147f-7cc4-4f4c-b9ae-f70a63057e33 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.231345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 13/25] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:33.235672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 13/26] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:33.237108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5014bc-9201-42e2-868f-c434df78d415 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.237597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5014bc-9201-42e2-868f-c434df78d415 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.238084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5014bc-9201-42e2-868f-c434df78d415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.269318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8f5014bc-9201-42e2-868f-c434df78d415 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:33.270887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8f5014bc-9201-42e2-868f-c434df78d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:33.405481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:33.445844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:33.454056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:33.593103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf15e1-1a73-47d8-a4b7-2116433fd5ae None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:33.615976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa36d-d4c6-4e0d-80ef-af0adaa62f01 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.616586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa36d-d4c6-4e0d-80ef-af0adaa62f01 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.617104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa36d-d4c6-4e0d-80ef-af0adaa62f01 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.618690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:33.625812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa36d-d4c6-4e0d-80ef-af0adaa62f01 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:33.644877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:33.645660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.646117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.646606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.679021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2d5eb147-067b-4721-bf47-407e59943df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:33.692709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:33.693778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:33.694521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:33.699361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 14/29] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:33.702874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.703320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.703730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.713789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:33.745396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:33.746596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:33.818385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa36d-d4c6-4e0d-80ef-af0adaa62f01 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:33.838767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:33.849342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 15/30] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:33.850852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:33.858598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:33.859470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:33.859912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:33.860327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:33.861352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:33.862982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:33.997416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 16/31] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 11:35:33 2022] POST /identity/v3/roles => generated 219 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:33.998708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.003518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041aa5f-91ca-436b-9234-eac44e94ebeb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.070819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.071659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.071944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.072218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.072901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:34.073228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.077660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.098341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 16/32] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:34.105479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.228464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:34.245582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e703-9dea-40d4-8f28-75f578aa4400 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.254159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:34.286321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.287320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.287799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.288289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.289341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0372-33cf-4590-a2fb-5cae08dba3db None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.303835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.306312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:35:34.324308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:34.325468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:35:34.326261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:35:34.326261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:35:34.326261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:34.327972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 17/33] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:34.329034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.335031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.335702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.336025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.336311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.341509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.343842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.345545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 17/34] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:34 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:34.346309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.459785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f848-47d7-42e5-9687-4c1ea2af5d45 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.475395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaa3db-c76f-4aff-a1a9-00efe9de0f30 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.501841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.502470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.502758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.503093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.503788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.504274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:34.505386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.516506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.517254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.517604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.517946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.518663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:34.519034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.520485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938f0c-6a7a-49f5-be31-be5cdb7aa14b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.521711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 18/35] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 11:35:34 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:34.522954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.546088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:34.548059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:34.549269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3852dc-7fc5-489c-968a-1346f47aa713 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.549506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3852dc-7fc5-489c-968a-1346f47aa713 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.549991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3852dc-7fc5-489c-968a-1346f47aa713 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.553465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 19/37] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:34.554554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3852dc-7fc5-489c-968a-1346f47aa713 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.671555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea9c4-6cb2-4e5a-8ea7-043c9b8f9588 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.703526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3852dc-7fc5-489c-968a-1346f47aa713 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.728416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.729439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.730480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.730966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.734277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.736301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c2393-7905-433a-be96-a2bcdf1a03de None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.738554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:34.743226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.743226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.743226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.750282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:34.751499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.751995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.752461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.753433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:34.754972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2072c-754c-4bf9-95f5-24f7bf535aa2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:34.762892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:34.764409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:34.832019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:34.833821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:34.852134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:34.884570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:35:34 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:34.886055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbec0-1e1f-4366-b017-34fbcc989ea0 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.886344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbec0-1e1f-4366-b017-34fbcc989ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.886641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbec0-1e1f-4366-b017-34fbcc989ea0 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.889025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 21/41] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:34.899121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:34.899632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:34.900096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:34.919935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:34.921869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:34.961771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b77e5-998e-48dc-a9ab-ebf282cd3dfb None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:34.971464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:35.002261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:35.003338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:35.003839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:35.004302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] PATH_INFO: `/v3/domains/default/users/362c24be2bf7418da80780e268b3a2f8/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:35.006981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=362c24be2bf7418da80780e268b3a2f8, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:35.008787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:35.030154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 22/42] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:35.031627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1361 bytes} [Tue Aug 30 11:35:34 2022] PUT /identity/v3/domains/default/users/362c24be2bf7418da80780e268b3a2f8/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:35.104697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:35.297755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:35.322005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf1544-5b94-4adc-b43d-e75099ca503c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:35.358305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:35.358931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:35.359215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:35.359493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:35.360176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:35.361747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:35.379403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 11:35:35 2022] POST /identity/v3/roles => generated 223 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:35.386464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:35.414218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e18cab-82c3-4eb9-9475-283097914b33 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:35.453860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:35.454513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:35.454791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:35.455060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:35.456514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:35.458034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282e342-ee08-489c-b4fa-e15e5adb041a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:35.459697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 22/45] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:35.465872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:35.505224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:35.584623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d220e5-93cc-4372-b45e-eb4dd1a5efdd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:35.618719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:35.619326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:35.619605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:35.619874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:35.620524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:35.621998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e39c4-7cc5-41a7-af05-5d70dc1439a5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:35.648520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:35:35 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:36.969122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc59d-3e8c-46d0-b191-0f1767a8b3f4 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:36.969715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc59d-3e8c-46d0-b191-0f1767a8b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:36.969715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc59d-3e8c-46d0-b191-0f1767a8b3f4 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:36.971006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:36.976395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:36.976959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:36.977476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:36.996126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:36.997356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:37.065682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:37.326450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc59d-3e8c-46d0-b191-0f1767a8b3f4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.431106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc59d-3e8c-46d0-b191-0f1767a8b3f4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:37.465288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:37.465916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.466191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.466465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.478926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a81e96af-1dfd-4071-8f32-8bfe397ec1ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:37.484863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:37.485823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:37.486588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:37.493484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.504488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:37.531174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee0ff-f7ec-4f9d-8159-2663e4d25b15 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.531458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee0ff-f7ec-4f9d-8159-2663e4d25b15 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.531732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee0ff-f7ec-4f9d-8159-2663e4d25b15 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.533105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 25/50] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:37.537877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.538163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.538444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.545573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:37.556909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:37.558125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:37.596086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1794aa-c3db-497f-8bdf-fade2fbe91fe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:37.626577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 26/51] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:37.629990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:37.630607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.630886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.631160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.631821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:37.632131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:37.633591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:37.641812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 26/52] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:37.647565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.747772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900e9f-4d22-42ff-b473-ad6b2edad747 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:37.782464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:37.783092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.783375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.783645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.784828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:37.786330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:37.787908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:37.793711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.864679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:37.886341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.889308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:37.900363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857069e-3950-4ace-b0e7-25b019619cfc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:37.936363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:37.937005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:37.937304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:37.937571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:37.938678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:37.940135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:37.942040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 27/54] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:37.947699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:37.995079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99866-c4a1-486a-871f-8dfac92c019c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:38.033226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:38.033853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:38.034135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:38.034406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:38.035482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:38.036948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:38.038761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:38.044131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:38.047283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bb614-0695-43cf-8b00-67ad74e6865c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:38.080176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:38.081137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:38.081419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:38.081689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:38.082401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.domain.id=default, user.id=362c24be2bf7418da80780e268b3a2f8) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:38.082703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:38.084137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729b58-952b-437e-9c27-befb1cdbdeed None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:38.090028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 28/56] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Aug 30 11:35:37 2022] GET /identity/v3/role_assignments?user.id=362c24be2bf7418da80780e268b3a2f8&scope.domain.id=default&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:38.118227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:38.152379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229a97-21c6-400f-b13c-d221e1cb8ba5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:38.188521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:38.189166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:38.189455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:38.189727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:38.190374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:38.191848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a280c-5f91-4ebd-8900-7c41b4402f44 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:38.223622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Aug 30 11:35:38 2022] POST /identity/v3/projects => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:35:40.130159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3e1f-90d7-4d17-8131-465a0ef76975 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:40.130999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3e1f-90d7-4d17-8131-465a0ef76975 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:40.130999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3e1f-90d7-4d17-8131-465a0ef76975 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:40.132995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:40.141812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:40.142235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:40.142392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:40.170488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:40.171699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:40.354018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:40.620528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3e1f-90d7-4d17-8131-465a0ef76975 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:40.625352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:40.738458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3e1f-90d7-4d17-8131-465a0ef76975 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:40.773245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:40.773936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:40.774220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:40.774495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:40.775660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:40.777153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ad44e-693f-4c7c-8d9a-48059c819b77 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:40.778727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:40.784827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:40.840679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:40.889691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532afe7-2617-4a27-89ab-23831a9851c7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:40.925323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:40.925920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:40.926198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:40.926468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:40.927106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:40.928535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966470a-3b51-4f84-a422-a9f3a23df2cf None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:40.955958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:35:40 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:35:43.909108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40db4-7518-45ac-abe7-5274a2c42694 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:43.909618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40db4-7518-45ac-abe7-5274a2c42694 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:43.909691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40db4-7518-45ac-abe7-5274a2c42694 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:43.910991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:43.916960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554ac97-98b4-4a09-be4b-ac823d9bb67b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:43.917880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554ac97-98b4-4a09-be4b-ac823d9bb67b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:43.918405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554ac97-98b4-4a09-be4b-ac823d9bb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:43.952155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3554ac97-98b4-4a09-be4b-ac823d9bb67b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:43.953759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3554ac97-98b4-4a09-be4b-ac823d9bb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:44.043347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:44.159808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206083d-5d4f-487d-829c-0c8392164f63 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.159808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206083d-5d4f-487d-829c-0c8392164f63 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.159808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206083d-5d4f-487d-829c-0c8392164f63 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.159808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 32/64] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:44.165708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fcc4-486b-4ebd-9eff-214580d840eb None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.166246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fcc4-486b-4ebd-9eff-214580d840eb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.166710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fcc4-486b-4ebd-9eff-214580d840eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.185534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e04c8-34d5-4931-9204-cc60f04a81d9 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.186152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e04c8-34d5-4931-9204-cc60f04a81d9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.186609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e04c8-34d5-4931-9204-cc60f04a81d9 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.188151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 33/65] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:44.191227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7481fcc4-486b-4ebd-9eff-214580d840eb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:44.193045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.193523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.193979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.197868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7481fcc4-486b-4ebd-9eff-214580d840eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:44.212736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:44.214272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:44.252507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.287997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:44.288535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.314563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:44.422474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.479317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9dd3-912c-47f5-a2be-96b7c4fca074 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.479925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9dd3-912c-47f5-a2be-96b7c4fca074 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.480389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9dd3-912c-47f5-a2be-96b7c4fca074 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.482051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 34/68] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:35:44.490303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.490809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.491272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.516434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:44.521898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:44.600609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afedc9-e2ff-4bd4-9781-efc2e3d66589 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:44.626208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:44.627637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.635310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:44.636142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.636582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.637087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.648542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:44.653698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:44.654537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:44.655295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:44.657571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:44.658600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.719590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.736415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.740160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b442-d239-4126-9806-f3fa8bc8d8f0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:44.762495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75214fa-2de0-467a-9dd6-2b9392b78c4c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:44.776590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:44.777465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.777905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.778177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.788170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:44.793173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:44.794084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:44.795121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:44.796743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.803635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:44.804273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.804808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.805246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.816484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-171aebe8-a868-4322-ac11-36e046b67f69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:44.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:44.822772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:44.824012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b89c-2440-47b2-9d80-d499749c01b1 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.825152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b89c-2440-47b2-9d80-d499749c01b1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.825152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b89c-2440-47b2-9d80-d499749c01b1 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.828678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 37/73] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:44.828678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b89c-2440-47b2-9d80-d499749c01b1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.907529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e31f0-68c1-48fe-8349-061d98a30095 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:44.934878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b89c-2440-47b2-9d80-d499749c01b1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:44.941130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:44.941804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.942087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.942355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.943022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:44.943322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:44.944720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:44.956388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.956714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:44.957584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:44.971940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:44.972489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.972767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.973076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:44.973743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:44.974045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:44.975478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605872-ff22-41ab-b2f3-992bf16f087d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:44.978903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:44.983936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:44.985179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:44.985468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:44.985747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.003187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:45.004392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:45.058117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc683-3cab-414c-bdcc-00c19b3041e3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.070698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:45.071517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.092844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.093499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.093786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.094064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.094734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:45.095042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.096427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.108940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 38/77] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:45.108940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.181978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1391-6124-42f2-97b3-d4807008f7fc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.190426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.195497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.211322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d09b8-1f10-4f82-84c7-6beaa0188ae7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.220480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.221455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.221889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.222361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.223645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.225433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.227356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:45.228360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.248997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.249740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.250023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.250297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.265546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.267008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.268654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 39/79] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:45.268654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.337673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ce0d-e937-4e5c-b672-7d1ce6706c38 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.372765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.373428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.373710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.373986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.374830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9fb55-f5b5-4db1-a33b-1d99e33046aa None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.375128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.376570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.378203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:45.380238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.407729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.408359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.408634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.408909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.410170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.411528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.413122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:45.413927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.424509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.434418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.484302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0acf67-3e6a-4f6b-b2de-12c2037ff2a2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.517830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5419-583b-4ddf-8a21-31ed946236f5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.520203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.520822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.521146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.521423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.522063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.523520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.550758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 42/82] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:35:45 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:45.551765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.560890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.561666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.562015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.562326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.639199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:45.640862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:45.653595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.672755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf564-ac14-4fb7-882b-95e26f213439 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.676344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.719925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.720986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.720986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.721158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.733116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:45.738038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:45.738851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:45.739628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 43/83] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:45.740253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.772920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 41/84] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:45.773878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:45.866229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a289af-86d4-4bc1-87b3-6a4a15b48814 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.902672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869987e-1dfd-4a5f-9ac9-58aa3eb51c9d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:45.909233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.910105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.910560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.910830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.913048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:45.945937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:45.946609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:45.946890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:45.947179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:45.953150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.004929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.006383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.041982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.043477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.140107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:46.140762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.158197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 42/86] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:46.159515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.172514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.212116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.262923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394c2de-43e5-4549-904c-5308d0977061 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.280787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada85dc-f314-4c48-82f3-fbb222b6508f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.308549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.309825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.310498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.310909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.311944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:46.312402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.314775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.317749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359993d0-84ea-4f95-849c-58883292258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.318491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359993d0-84ea-4f95-849c-58883292258c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.318876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359993d0-84ea-4f95-849c-58883292258c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.319248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359993d0-84ea-4f95-849c-58883292258c None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.320644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359993d0-84ea-4f95-849c-58883292258c None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.322277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359993d0-84ea-4f95-849c-58883292258c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.324051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 43/87] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.325336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 45/88] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.326382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.329800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359993d0-84ea-4f95-849c-58883292258c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.427076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.433903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa930d-ceb5-4b46-a352-153d9355ff0e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.457392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359993d0-84ea-4f95-849c-58883292258c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.460186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.471060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.471605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.471986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.472361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.473632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.475202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.477424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 46/89] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.482910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.500141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.501006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.501748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.502162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.503674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.505806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.508017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 44/90] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.509328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.618757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1be05-5edf-4cfc-9463-48631c994092 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.622872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63c8fe-eed8-4abe-a33f-3c4a56c4e859 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.661927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.662158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.662717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.662818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.663002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.663279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.663377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.665007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.665107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.665177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:46.665177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.665988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.666460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.667793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 45/91] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.668347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.672437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 47/92] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.677701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.702934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.801009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:46.875615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd604-744b-4d3a-a128-2c62fdef0186 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.883761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723c52-86b3-454b-888f-d68a3188d517 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:46.925613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.927421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.927705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.927985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.928722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=362c24be2bf7418da80780e268b3a2f8) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:46.929054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.932912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.941496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:46.942117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:46.942401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:46.942674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:46.943406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:46.943712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:46.945297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:46.950178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 46/93] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/role_assignments?user.id=362c24be2bf7418da80780e268b3a2f8&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:46.951007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:46.959474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 48/94] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:47.072478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:47.103540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f932d-f2bd-4c6c-b92c-405c964b314c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:47.149507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:47.150069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:47.150351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:47.150627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:47.240828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:47.246621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:47.326360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:47.356824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 47/95] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:47.362542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:47.514143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cb88-9cb9-4e71-8023-0566a64f06ad None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:47.566811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:47.593697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:47.594357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:47.594641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:47.594918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] PATH_INFO: `/v3/projects/6e698512b63944988124040cb6557475` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:47.596175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] RBAC: Authorizing `identity:get_project(project_id=6e698512b63944988124040cb6557475)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:47.597682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fba4d2-4d68-427a-8567-725bd49f49ac None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:47.599351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:47 2022] GET /identity/v3/projects/6e698512b63944988124040cb6557475 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:47.605850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:47.716992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290bee-0783-44dc-93e0-4855a8d289b3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:47.751127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:47.751668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:47.751953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:47.752291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:47.753049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=6e698512b63944988124040cb6557475, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:47.753758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:47.755231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852382d-9f4a-4d45-9a08-54dbd7545c48 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:47.763733 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 48/97] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:47 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=6e698512b63944988124040cb6557475&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:48.114931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06392d-8fe7-47f4-9e02-177e42a85421 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:48.115471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06392d-8fe7-47f4-9e02-177e42a85421 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:48.115554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06392d-8fe7-47f4-9e02-177e42a85421 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:48.117227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 50/98] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:48.122425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:48.122827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:48.122989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:48.144237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22eebc-75bf-482d-9974-d58ed69dd73c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:48.144553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22eebc-75bf-482d-9974-d58ed69dd73c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:48.144796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22eebc-75bf-482d-9974-d58ed69dd73c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:48.146435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 51/99] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:48.151191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:48.151475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:48.151754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:48.168494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:48.169735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:48.182435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:48.183632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:48.243298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:48.296665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 52/100] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:48.301066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 49/101] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:48.818209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:48.821966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:49.037030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6f24d-599d-4add-80da-a5f52663c548 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.055797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba423d2-385c-4efe-b63d-9cb06c82c24e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.059554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:49.092363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.093342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.093848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.094331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.114466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:49.119809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:49.121180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:49.121935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:49.126899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 53/102] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:49.129136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.130294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.130767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.131240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.133171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:49.133956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:49.135621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:49.140867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 50/103] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:49.146129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:49.210992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:49.292078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdbda-9601-4bdd-a23a-75de1032b4e4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.327701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c5dd4-b12b-42c6-ac04-756df5685055 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.341727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.342713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.343208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.343693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.344554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:49.345089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:49.346682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:49.357604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 54/104] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:49.369275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:49.397688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.398655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.399073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.399510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.400309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:49.402034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:49.443668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:49.461836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 51/105] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:35:49 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:49.540086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d10d5-2136-4670-9e73-61b6cbc43021 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.587334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.588071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.588358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.588636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] PATH_INFO: `/v3/users/63d2090dd4ad47cfac41035bb63518cd` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.612080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] RBAC: Authorizing `identity:get_user(user_id=63d2090dd4ad47cfac41035bb63518cd)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:49.613527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b92fa-2dd8-484b-819d-d36524e5a06e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:49.615239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 55/106] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:49 2022] GET /identity/v3/users/63d2090dd4ad47cfac41035bb63518cd => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:49.621808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:49.745609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:49.755740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc136-ecbe-415c-986b-fd3d1d1ef1fa None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:49.803506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:49.804185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.804553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.804828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.911134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:49.912958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73020c9b-debe-452c-8f1a-fbfb94bad332 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:49.931413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84829-2d96-4938-a7ec-9e243644d9bf None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.931720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84829-2d96-4938-a7ec-9e243644d9bf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.931973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84829-2d96-4938-a7ec-9e243644d9bf None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.933506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 56/107] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:49.939042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad26e-4c5f-489f-ab60-ad3ac6935816 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:49.939325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad26e-4c5f-489f-ab60-ad3ac6935816 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:49.939601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad26e-4c5f-489f-ab60-ad3ac6935816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:49.963552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-01bad26e-4c5f-489f-ab60-ad3ac6935816 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:49.964755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-01bad26e-4c5f-489f-ab60-ad3ac6935816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:50.031062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.041747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 52/108] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:50.043280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3ce7f-770a-4f21-b60b-36c6e8dfef93 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.044015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3ce7f-770a-4f21-b60b-36c6e8dfef93 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.044293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3ce7f-770a-4f21-b60b-36c6e8dfef93 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.045706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 53/109] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:50.047176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3ce7f-770a-4f21-b60b-36c6e8dfef93 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.079891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 57/110] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:50.082935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9111c6-ada4-46c3-8999-33abebe2dc22 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.083675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9111c6-ada4-46c3-8999-33abebe2dc22 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.084563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9111c6-ada4-46c3-8999-33abebe2dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.109782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8c9111c6-ada4-46c3-8999-33abebe2dc22 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:50.111804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8c9111c6-ada4-46c3-8999-33abebe2dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:50.138918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.179222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3ce7f-770a-4f21-b60b-36c6e8dfef93 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.190657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 58/111] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:50.192823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469703a6-f115-4ef5-b9af-17a854b1f3fd None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.193228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469703a6-f115-4ef5-b9af-17a854b1f3fd None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.193515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469703a6-f115-4ef5-b9af-17a854b1f3fd None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.195483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 59/112] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:50.202332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a237-c3a3-4e35-ba8e-fe0463428586 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.202838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a237-c3a3-4e35-ba8e-fe0463428586 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.203259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a237-c3a3-4e35-ba8e-fe0463428586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.220659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.221698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.222242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.222760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.224388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:50.226260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:50.228765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 54/113] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:50.236994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2d00a237-c3a3-4e35-ba8e-fe0463428586 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:50.237176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2d00a237-c3a3-4e35-ba8e-fe0463428586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:50.238420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.304074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.308413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 60/114] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:50.309776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135981-7281-487e-9654-ae58d78d9d01 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.310066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135981-7281-487e-9654-ae58d78d9d01 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.310351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135981-7281-487e-9654-ae58d78d9d01 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.311752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 61/115] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:50.317197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.317318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.317515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.335865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:50.337101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:50.352797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab0e0f-db6a-439a-851d-c3179a67e845 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.388869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.390204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.390674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.391138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.392047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=63d2090dd4ad47cfac41035bb63518cd) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:50.392542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:50.394241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:50.400561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 55/116] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/role_assignments?user.id=63d2090dd4ad47cfac41035bb63518cd&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:50.414638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 62/117] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:50.454032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.562361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c247ab-009c-401c-81c3-52695623e33f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.588131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.601797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.602635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.602917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.603191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.614639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:50.620614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:50.621473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:50.622230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 56/118] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:50.630125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.658014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.673409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.781070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61401bee-75a3-42f1-b4d2-81fd1e773280 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.798323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c2dc-08d4-4919-a290-af852c75083a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.820848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.821506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.821789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.822063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.822748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:50.823054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:50.824477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:50.836661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 63/119] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:50.836661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.849545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.850571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.851228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.851692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.864063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:50.871240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:50.872086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:50.872835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:50.879879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 57/120] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:50.881099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:50.920522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.934737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:50.938901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62960-4d66-49e2-bd66-176bb444c0de None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:50.973760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:50.974458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:50.974741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:50.975021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:50.986110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:50.991582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:50.992472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:50.993668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 64/121] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:50.994555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.000421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083ae7-ef03-4369-9287-0ac39c68509a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.036360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.036914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.037248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.037524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.039070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.040618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.042657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 58/122] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.043447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.095415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a224d-e3f2-4cb2-8cdb-5d7d17311b08 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.129913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.130597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.130885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.131160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.131833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:51.132136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.133676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.142877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 65/123] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.143704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.149923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd61e6-9e8b-45c1-aa21-beb82166f6c6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.161054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.173356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.187827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.189110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.189531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.189937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.201250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:51.207220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:51.208116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:51.208897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:51.211606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 59/124] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:51.212720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.248445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd98f4-d2f7-47c9-bd29-d2a4725c924c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.290319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.291518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.291804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.292081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.292751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:51.293247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.295028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.309014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 66/125] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.309014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.338616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4414-c187-45f7-b928-2963191cb277 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.376894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.379951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.380999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.381383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.381757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.383095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.385541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.391351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 60/126] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.392414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.421743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6bf4-d0d2-4938-a52f-09cb0c48a494 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.441352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.459481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.460302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.460877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.461346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.462911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.464560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.466517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 67/127] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.468627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.513711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58c99-dd47-4f04-bb74-325a0df7bf7d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.555403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.556045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.556393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.556737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.557519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:51.557886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.559353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.573118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 61/128] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.574267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.591604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dccc8-256c-4796-9c8b-b375371c04fa None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.628106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.629414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.629859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.630399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.631853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.633983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.636027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 68/129] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.637074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.640053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.700457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.705157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0293-dce3-480a-8943-f987779dccad None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.740988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.741899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.742397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.742625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.744652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, user_id=4294cdf4c1754def86cfd1fa0399fd6b, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.746270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.761130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fc9ae-0de9-4bdb-9947-cae92fbf3fd9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:51.765048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 62/130] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:35:51 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:51.766222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.841119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:51.844457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:51.844999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:51.845440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:51.848084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:51.853514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:51.855742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 69/131] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:51.858685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:51.972311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:51.976653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe1b9-69cb-4173-9ce9-ea3dc9a971e8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.008537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298902b0-eaf0-4873-a89a-171c15298454 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.019767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.020796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.021129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.021458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.022796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.025111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.027159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 63/132] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:52.027807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:52.057964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.058608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.058885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.059160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] PATH_INFO: `/v3/projects/6e698512b63944988124040cb6557475` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.060281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] RBAC: Authorizing `identity:get_project(project_id=6e698512b63944988124040cb6557475)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.063462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:52.070210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.072364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 70/133] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:51 2022] GET /identity/v3/projects/6e698512b63944988124040cb6557475 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:52.077063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:52.166183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f3ee-8bc9-4ac5-85fb-78a1678207b4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.210868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.211694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.211982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.212319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/362c24be2bf7418da80780e268b3a2f8/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.214971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, user_id=362c24be2bf7418da80780e268b3a2f8, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.215965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c284-702b-43bc-b401-673d857536ce None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.216514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.235963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 64/134] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:35:52 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/362c24be2bf7418da80780e268b3a2f8/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:52.237498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:52.273774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.275896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.277514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.277999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.281058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.284492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00c452-8aea-4d4d-a18b-e77d3afe9eda None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.287880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 71/135] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:52 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:52.298275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7099a4-c6d6-4337-855f-d6f86c998ad2 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.298911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7099a4-c6d6-4337-855f-d6f86c998ad2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.299385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7099a4-c6d6-4337-855f-d6f86c998ad2 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.306776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 72/136] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:52.307605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7099a4-c6d6-4337-855f-d6f86c998ad2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:52.323160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:52.375902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:52.391106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0fed3-4767-4be4-a59b-cb803cfcaac7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.434952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.435979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.436457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.436925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] PATH_INFO: `/v3/projects/6e698512b63944988124040cb6557475/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.440023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e698512b63944988124040cb6557475, user_id=4294cdf4c1754def86cfd1fa0399fd6b, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.441629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b4314-dce8-4119-83d7-92496156f346 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.466699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 65/137] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:35:52 2022] PUT /identity/v3/projects/6e698512b63944988124040cb6557475/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:52.468842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47756e2-a3c1-49bb-b7e5-67b376d4d67a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.469540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47756e2-a3c1-49bb-b7e5-67b376d4d67a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.469987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47756e2-a3c1-49bb-b7e5-67b376d4d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.499256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a47756e2-a3c1-49bb-b7e5-67b376d4d67a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:52.500526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a47756e2-a3c1-49bb-b7e5-67b376d4d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:52.505835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7099a4-c6d6-4337-855f-d6f86c998ad2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:52.551416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:52.552437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.552942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.553865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.556465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, user_id=4294cdf4c1754def86cfd1fa0399fd6b, role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:52.558430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0db6-3ca0-4d7e-b404-e9d6f89c6d2e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:52.579895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 73/138] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:35:52 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/4294cdf4c1754def86cfd1fa0399fd6b/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:52.611596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 66/139] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:52.945013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa30-d119-4f46-b909-6b16b6e7c822 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.945383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa30-d119-4f46-b909-6b16b6e7c822 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.945638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa30-d119-4f46-b909-6b16b6e7c822 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.947127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 74/140] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:52.952513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:52.952799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:52.953098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:52.963885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fa30-d119-4f46-b909-6b16b6e7c822 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:52.994477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:52.995675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:53.093593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:53.118388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 67/141] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:53.169261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fa30-d119-4f46-b909-6b16b6e7c822 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:53.213899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:53.214796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:53.215077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:53.215353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:53.217669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:53.219808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:53.221640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 75/142] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:35:53.227515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:53.243032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:53.376514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71dfc1-bc45-4dcf-b2fb-037da2c45f84 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:53.420565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:53.421199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:53.421485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:53.421753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:53.422409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:53.423904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:53.459514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 68/143] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:35:53 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:53.503535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:53.636502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac9ef-d6ce-4986-9799-09321894cb41 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:53.670896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:53.671863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:53.672362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:53.672824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:53.674903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:53.685197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:53.690509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:53.691351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:53.692563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 76/144] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:53.698091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:53.774157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:53.820128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c914-ba23-4c64-83f7-761e2975276e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:53.861276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:53.861907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:53.862194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:53.862475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:53.863163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:53.863476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:53.864874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:53.876578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 69/145] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:53.882251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:54.019254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1672-af11-4e06-b869-8d4449b17b35 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:54.060721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:54.061408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:54.061687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:54.061961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] PATH_INFO: `/v3/users/63d2090dd4ad47cfac41035bb63518cd` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:54.063101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] RBAC: Authorizing `identity:get_user(user_id=63d2090dd4ad47cfac41035bb63518cd)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:54.064575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:54.066212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 77/146] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:53 2022] GET /identity/v3/users/63d2090dd4ad47cfac41035bb63518cd => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:54.072057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:54.189672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e610-47a8-4fa1-99c4-0019b177d81b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:54.227045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:54.239716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:54.240474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:54.240702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:54.240999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:54.242325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:54.243803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe93bdd-564a-4460-b4c4-13839988b839 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:54.245507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 70/147] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:54 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:54.251438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:54.318288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:54.365938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e078-ed45-4006-acd6-e9edff26e22b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:54.405629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:54.406312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:54.406593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:54.406868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/63d2090dd4ad47cfac41035bb63518cd/roles/ecef4df8fae44483bc5db6a2527c7ba3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:54.408810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, user_id=63d2090dd4ad47cfac41035bb63518cd, role_id=ecef4df8fae44483bc5db6a2527c7ba3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:54.410395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf46810-54bf-441b-b623-422c565c6205 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:54.427646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 78/148] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:35:54 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/users/63d2090dd4ad47cfac41035bb63518cd/roles/ecef4df8fae44483bc5db6a2527c7ba3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:35:54.568237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff74933-e194-4a5d-bc47-c70c3d2d1cb1 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:54.568611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff74933-e194-4a5d-bc47-c70c3d2d1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:54.568795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff74933-e194-4a5d-bc47-c70c3d2d1cb1 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:54.570548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 71/149] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:54.576695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e0ce-c124-48cb-967e-6a65027684d2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:54.577004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e0ce-c124-48cb-967e-6a65027684d2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:54.577299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e0ce-c124-48cb-967e-6a65027684d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:54.602413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6691e0ce-c124-48cb-967e-6a65027684d2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:54.603657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6691e0ce-c124-48cb-967e-6a65027684d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:54.684899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 79/150] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:55.045916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9502c1-63eb-4f07-8cd9-3f27383460f6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.046272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9502c1-63eb-4f07-8cd9-3f27383460f6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.046547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9502c1-63eb-4f07-8cd9-3f27383460f6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.048087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 72/151] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:55.054286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7689-c075-4485-bb22-e89a6e19f7f0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.054577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7689-c075-4485-bb22-e89a6e19f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.054853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7689-c075-4485-bb22-e89a6e19f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.078076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d0af7689-c075-4485-bb22-e89a6e19f7f0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:55.079305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d0af7689-c075-4485-bb22-e89a6e19f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:55.134985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:55.158801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 80/152] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:55.185903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9502c1-63eb-4f07-8cd9-3f27383460f6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:55.304764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9502c1-63eb-4f07-8cd9-3f27383460f6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:55.343826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:55.344469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.344751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.345065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.362583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:55.368125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:55.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:55.370263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 73/153] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:55.373049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1da0-f73c-4ae3-b001-4b07e5b71633 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.373572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1da0-f73c-4ae3-b001-4b07e5b71633 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.373722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1da0-f73c-4ae3-b001-4b07e5b71633 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.375183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 81/154] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:55.379906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.380188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.380464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.384137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:55.422010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:55.423211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:55.487926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:55.586831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 82/155] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:35:55.605400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a674-bba9-4323-9f6f-10e221b06da2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:55.663247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:55.663897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.664179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.664455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.665153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:55.665461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:55.666860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:55.675705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 74/156] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:55.681427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:55.730068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:55.850958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f48f-f464-45cc-b4e2-fb9cc5df7e6b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:55.877281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d12d-8db8-4c22-a187-951d14347933 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:55.885319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:55.905229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:55.923163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:55.923830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.924111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.924389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.927295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:55.928784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:55.931456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 83/157] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:55.937705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:55.937854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:55.938460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:55.938692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:55.938972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:55.966017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:55.971472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:55.972596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:55.973827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 75/158] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:55.981941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:56.110774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ce49-de7d-45c1-806e-a632019a8e31 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:56.159142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0e71-53a8-46d5-ad59-88825617b888 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:56.202569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:56.203622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.204133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.204592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.227443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:56.228079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.228363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.228636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.229505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:56.229815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:56.231376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:56.248403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 76/159] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:56.249312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:56.308619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:56.317330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:56.378176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:56.380329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ddbd0-f243-4bac-8970-8db69d47745b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:56.412880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d61ee-9aa1-4e15-8109-ce8e3005fac9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:56.465931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:56.466585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.466866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.467138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.490559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:56.497409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:56.498357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 77/160] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:56.504125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:56.634442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73580402-c5e9-4e74-8d4b-1c8953631a4e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:56.637284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:56.670848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:56.671499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.671785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.672066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.673379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:56.675207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f59b89-bc8a-4af0-87f0-e3c0e2d14cd4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:56.677390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 78/161] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:56 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:56.678527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f4254-a27b-4d1f-9367-978031821cb4 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.678964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f4254-a27b-4d1f-9367-978031821cb4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.679424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f4254-a27b-4d1f-9367-978031821cb4 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.680995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 79/162] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:56.686109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f4254-a27b-4d1f-9367-978031821cb4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:56.703346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 84/163] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:35:56.704805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.705509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.705884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.744052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:56.745458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:56.822477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f4254-a27b-4d1f-9367-978031821cb4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:56.859701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:56.860334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:56.860622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:56.861234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:56.862006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:56.862571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:56.864086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:56.880629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 80/164] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:56.881522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:56.969461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:56.988180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 85/165] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:56.989337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.014620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:57.023082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe83332-92a3-4284-b628-36d20f917025 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.074673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.075307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.075595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.076027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.175330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:57.176806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:57.239453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:57.267234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d50a7-8d23-4dcc-84e8-05bbdcfe256a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.350850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.351545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.351824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.352088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.354821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:57.356281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:57.362701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 86/166] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:56 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:57.364298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.394793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 81/167] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:57.395821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.528591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:57.575848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b63c-ca2d-4346-b549-9fb979a1d981 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.607211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9cff-d6bf-49ef-b297-43ca39a3fc27 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.640702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.641805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.642278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.642807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] PATH_INFO: `/v3/users/362c24be2bf7418da80780e268b3a2f8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.643415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:57.645741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] RBAC: Authorizing `identity:get_user(user_id=362c24be2bf7418da80780e268b3a2f8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:57.647465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:57.650248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 87/168] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/users/362c24be2bf7418da80780e268b3a2f8 => generated 247 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:57.653525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.656862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.657775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.658201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.658606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.659468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:57.659917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:57.661758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:57.668908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 82/169] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:57.670108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.828883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95778b-6826-4a6e-afa7-d856a75cfef2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.836749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc547cb-147b-49e7-b821-9323078332d9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:57.895220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.895866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.896237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.896514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.898141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:57.899372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:57.901224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:57.901350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 88/170] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:57.901868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.902046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:57.902136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.902398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.916111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:57.919625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-84c9949a-e001-4dad-bdb6-b0f5941e81bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:57.923245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:57.924109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:57.925525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 83/171] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:57.927364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04aa-6481-4c0f-939c-1c8bd8a65130 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.927364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04aa-6481-4c0f-939c-1c8bd8a65130 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.927364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04aa-6481-4c0f-939c-1c8bd8a65130 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.930609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 84/172] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:57.933087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d01b6-a692-4012-b7cc-b1c37d05d56a None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:57.933087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d01b6-a692-4012-b7cc-b1c37d05d56a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:57.933087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d01b6-a692-4012-b7cc-b1c37d05d56a None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:57.938765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 85/173] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:57.939666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d01b6-a692-4012-b7cc-b1c37d05d56a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.016644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.030185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e33ff-b9b8-4a2e-b887-942392f28849 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.066836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d01b6-a692-4012-b7cc-b1c37d05d56a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.068075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.068736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.069037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.069308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.105188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.105727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.106005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.106277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.107089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:58.107403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.108878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.115890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 86/174] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:58.117593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.145553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.147039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced689df-be89-495a-b4b7-d846be9efd56 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.164251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.232657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a9df-10de-4ed1-abf3-c1b662ec1841 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.256080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.263092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 89/175] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:58.264420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.266970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.267255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.271302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.271886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.272282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.272565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.273319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:58.273845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.275520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da5e45-61a7-4c3d-8205-603cf4454965 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.284752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 87/176] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:58.286219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042a8c-59a3-4af3-88b6-c40c2f269c58 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.286508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042a8c-59a3-4af3-88b6-c40c2f269c58 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.286605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:58.286773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042a8c-59a3-4af3-88b6-c40c2f269c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.287735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:58.306400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6a042a8c-59a3-4af3-88b6-c40c2f269c58 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:58.307701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6a042a8c-59a3-4af3-88b6-c40c2f269c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:58.364504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:58.365356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.381998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 88/178] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:58.385042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f0f9-c2a5-401a-bb38-7c5a82780c18 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.385042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f0f9-c2a5-401a-bb38-7c5a82780c18 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.385042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f0f9-c2a5-401a-bb38-7c5a82780c18 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.386056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 89/179] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:58.389351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f0f9-c2a5-401a-bb38-7c5a82780c18 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.437624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.503015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e166-a581-44d3-84e0-0cf906977339 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.506153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f0f9-c2a5-401a-bb38-7c5a82780c18 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.517063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.545313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.545958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.546235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.546504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] PATH_INFO: `/v3/users/4294cdf4c1754def86cfd1fa0399fd6b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.546994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.547747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] RBAC: Authorizing `identity:get_user(user_id=4294cdf4c1754def86cfd1fa0399fd6b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.548360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.548825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.549237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd1167-4140-4fda-b22f-3ac2fcc44c85 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.549538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.551122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.551225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 90/180] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/users/4294cdf4c1754def86cfd1fa0399fd6b => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:58.552340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673ce8-c818-459e-9619-c26a67aaff59 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.552625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673ce8-c818-459e-9619-c26a67aaff59 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.552899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673ce8-c818-459e-9619-c26a67aaff59 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.553529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.554225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 91/181] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:35:58.555849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 91/182] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:58.557262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc12ae-d5d6-4d7c-b1fc-d6563e365d34 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.557755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc12ae-d5d6-4d7c-b1fc-d6563e365d34 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.558224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc12ae-d5d6-4d7c-b1fc-d6563e365d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.559771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.594028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-36fc12ae-d5d6-4d7c-b1fc-d6563e365d34 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:58.595494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-36fc12ae-d5d6-4d7c-b1fc-d6563e365d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:58.673094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 92/183] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:58.673094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.673094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.673094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.675124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08e738-7523-443e-825c-4ad02fda81bb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.690063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:35:58.691253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:35:58.692576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.716352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.717102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.717386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.717641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.759832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 93/184] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:35:58.769862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.789836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.791328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.814266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.900705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 92/185] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:35:58.900898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80702837-65f3-41e2-b353-67542cafbb6c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:58.902139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:58.917562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:58.948535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:58.949111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:58.949941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:58.950220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:58.950960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=362c24be2bf7418da80780e268b3a2f8) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:58.951302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:58.953619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:58.962082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 94/186] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/role_assignments?user.id=362c24be2bf7418da80780e268b3a2f8&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:58.962713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.029154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbb0-3632-49b9-8477-ad44df10571a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.069285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.070051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.070333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.070611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.080665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.083336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:59.084289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcaa45-f9e0-46fc-8670-428b43f22a94 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:59.088342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:59.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:59.090113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 93/187] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:59.095271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.125716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.126363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.126653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.126908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.141048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:59.147108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:59.148106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 95/188] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:59.149115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.175394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.209069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db833c-62bf-415c-9258-3a2249caa1b0 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.244233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.244866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.245174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.245458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] PATH_INFO: `/v3/projects/6e698512b63944988124040cb6557475` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.246680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] RBAC: Authorizing `identity:get_project(project_id=6e698512b63944988124040cb6557475)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.248193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.249849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 94/189] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/projects/6e698512b63944988124040cb6557475 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.250606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.266220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2aebc-f89f-424f-89bc-d230bda88507 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.302231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.302869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.303153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.303425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.304623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.306230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.307837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 96/190] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.308591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.336478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.355045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca265-8ff0-4f37-a8f1-f9c3bdd7e0bd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.389641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.390299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.390574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.390840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.398533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.402237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:35:59.406983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:35:59.408041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:35:59.408918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 95/191] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:35:59.409712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.411915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912490-a676-49f5-9007-7e55b8e87c9b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.446313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.446914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.447188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.447451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.448109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:59.448407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.449829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.457925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 97/192] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.458698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.512355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765eb2-5390-4ac0-ad12-eaf3b405e7d9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.544613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.545251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.545531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.545804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.546468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:59.546771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.548189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.549597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.557758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 96/193] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.558372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.559412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c1a1-08d6-4c97-b08b-63b865bbe467 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.593528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.594143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.594424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.594697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.595457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=6e698512b63944988124040cb6557475, user.id=4294cdf4c1754def86cfd1fa0399fd6b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:59.595766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.597283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.603196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 98/194] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/role_assignments?user.id=4294cdf4c1754def86cfd1fa0399fd6b&scope.project.id=6e698512b63944988124040cb6557475&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.604149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.634967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.678054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03ac7-0059-4bc5-abb0-48bb53fca7dc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.714977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd36f-3ce7-40a2-8254-03c8711c362c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.717326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.717960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.718240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.718513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.719187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.720683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.744514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 97/195] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:35:59 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:35:59.744802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.753983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.754631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.754897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.755169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.755855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:35:59.756161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.757769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.767463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 99/196] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.768333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.794589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.874284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438ad65-1116-44c8-8bc6-d4c5783cd87c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.895184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:35:59.924179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.924586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d158-1936-4687-a737-b2bbafcb46f0 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:35:59.925297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.925570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.925841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] PATH_INFO: `/v3/users/63d2090dd4ad47cfac41035bb63518cd` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.926993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] RBAC: Authorizing `identity:get_user(user_id=63d2090dd4ad47cfac41035bb63518cd)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.928448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.930350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 98/197] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/users/63d2090dd4ad47cfac41035bb63518cd => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.935924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:35:59.964558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:35:59.965234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:35:59.965510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:35:59.965780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:35:59.982633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:35:59.984656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:35:59.986950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 100/198] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:35:59.988303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.065914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cb37-dc8b-4073-aa15-bc7b322b0064 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.083179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.114580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.116589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.116885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.117185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.119024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.120469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.121382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5351-95a6-4595-840e-6343d58373fc None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.122258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 99/199] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:00.127946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.166482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.167503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.168012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.168476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.186743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.232787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd47b2-d7ae-4fd3-bdb3-6419d29697e3 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.247728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.249686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.267171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.267689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.267969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.268242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.334948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.340153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.366258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 101/200] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:00.367813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.399696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.452749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 100/201] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:00.452749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.494093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb38e1-37ce-4680-b8ed-4932b90a83f4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.532297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.532904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.533222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.533489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.561143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00c-a073-4be6-9287-75cf583eab62 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.577623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.600145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.601184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.601732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.602179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.603581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.605133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.605509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.606595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.607530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 101/202] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:00.608572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.634026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.719032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d97b-5449-4805-9338-47abd6b0eaea None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.737105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 102/203] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:00.738294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.759247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.759931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.760207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.760474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.762079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.764125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.766330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 102/204] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:00.766986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.833454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.863602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438239fc-e35e-45d6-98ba-6f44d3387fb6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.883967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:00.898435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660731a-2816-4452-8ab6-dc4fbda88c9b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:00.903132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.903860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.904233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.904597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.905518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, scope.project.id=dbf5da46264042c49bfb291ea9edf81a, user.id=63d2090dd4ad47cfac41035bb63518cd) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:00.905918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.907460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.914034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 103/205] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/role_assignments?user.id=63d2090dd4ad47cfac41035bb63518cd&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:00.915123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:00.953232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:00.957909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:00.958453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:00.958897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:00.960488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:00.964706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:00.974331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 103/206] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:00.990466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:01.105720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b138-2359-4a0c-b9a1-8809bff34ce9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:01.142758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca98e-0c5e-4ca9-b8bf-0c3460ad66d5 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:01.146345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:01.147035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.147400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.147770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.148691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=944fc39083a34d6888617d4e6c4c7e46) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:01.149035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:01.150500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e38b1-1351-4c04-8e0f-e5f6e8269387 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:01.157933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 104/207] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/role_assignments?user.id=944fc39083a34d6888617d4e6c4c7e46&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:01.180138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:01.180944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.181334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.181695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.182559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=944fc39083a34d6888617d4e6c4c7e46) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:01.182966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:01.184467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5cdba-a38f-4dac-9890-be48163fba12 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:01.191963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 104/208] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:00 2022] GET /identity/v3/role_assignments?user.id=944fc39083a34d6888617d4e6c4c7e46&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:01.871194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b779-8e89-4753-b99c-149471fdf4b8 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.871713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b779-8e89-4753-b99c-149471fdf4b8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.871713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b779-8e89-4753-b99c-149471fdf4b8 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.873128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 105/209] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:01.878607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.879019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.879212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.897580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:01.898795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:01.915735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:01.969173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0ab34-c703-476d-b3af-e9945292cbd8 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.969481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0ab34-c703-476d-b3af-e9945292cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.969718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0ab34-c703-476d-b3af-e9945292cbd8 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.971076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 106/210] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:01.972019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 105/211] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:01.978232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:01.978794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:01.979261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:01.987605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:01.998850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:02.000291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:02.067947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 107/212] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:02.232029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.341692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c562-0e60-47e0-9a63-45fbcfeb51b7 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.347493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.386627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.387641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.388115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.388577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:02.403756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:02.410581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:02.411474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:02.412265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:02.414354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 106/213] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:02.420611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.435875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:02.475188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700679e-c0eb-45ec-8d18-d4da41d5e10a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.519641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:02.528382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.529910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.530707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.531171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:02.532280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd039a-e9f2-4fd6-8d64-6e7b8167c2d7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.532734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:02.535555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:02.537459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 108/214] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:02.543740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.571519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.572275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.572644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.573031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:02.573897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:02.574267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:02.575733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:02.590441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 107/215] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:02.591538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.659604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83935f5-59a6-47bd-a067-ea7625d8840e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.677706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:02.698014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.698764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.699159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.699489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:02.700459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:02.701851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:02.706918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e74f-9d7f-4676-b789-ad576ea977d1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.737002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 109/216] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:02 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:02.752102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.752678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.752954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.753257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] PATH_INFO: `/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:02.771221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a35d36bbc47f691c8dad3a2148a7b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:02.772902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:02.774996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 108/217] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:02 2022] GET /identity/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:02.780891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:02.847402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:02.896084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74feb5-fa2f-428d-937b-ca1cae951ec9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:02.932231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:02.932849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:02.933153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:02.933418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.004563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:03.005998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a118a-210d-4088-aa33-686c940b53c7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:03.061303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:03.110078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 110/218] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:03.115791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:03.128073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d37251-f43d-448a-89f8-6805c0a40b11 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.128374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d37251-f43d-448a-89f8-6805c0a40b11 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.128614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d37251-f43d-448a-89f8-6805c0a40b11 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.130328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 111/219] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:03.131998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cde8-0e01-4755-ac35-6bd74bd6b068 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.132750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cde8-0e01-4755-ac35-6bd74bd6b068 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.133441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cde8-0e01-4755-ac35-6bd74bd6b068 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.135106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 112/220] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:03.139118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7cc-4d82-4efe-99e3-93c2a4c1aed1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.139118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7cc-4d82-4efe-99e3-93c2a4c1aed1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.139118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7cc-4d82-4efe-99e3-93c2a4c1aed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.158275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b1b5b7cc-4d82-4efe-99e3-93c2a4c1aed1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:03.159791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b1b5b7cc-4d82-4efe-99e3-93c2a4c1aed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:03.238252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 113/221] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:03.245039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78af62-7ea7-49d2-8e1d-9d0cff279b47 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:03.246636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.247070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.247590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.271980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:03.277093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:03.277750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.278379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.278958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.279347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:03.280558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:03.280871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:03.282245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:03.287617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 109/222] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:03 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:03.293490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:03.442836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 114/223] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:03.453774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8a98d-248f-47c1-ba1c-386575923f09 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:03.489455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:03.490519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.490519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.490676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.491331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=fe6a35d36bbc47f691c8dad3a2148a7b) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:03.491862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:03.495419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:03.499548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 110/224] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:03 2022] GET /identity/v3/role_assignments?user.id=fe6a35d36bbc47f691c8dad3a2148a7b&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:03.544389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:03.563441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:03.667247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928603-2344-4fb8-9725-2cbfeb4d37f4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:03.709973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:03.710647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:03.710922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:03.711186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:03.723956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:03.729047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:03.729929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:03.730719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 115/225] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:03.737707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:03.829068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:03.841651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:03.937322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:03.951758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec9e5e-5962-4a88-9a5a-22d753edd402 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:03.964170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c96696-bb22-4fae-be4c-d47edf638a65 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.005218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.006205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.006679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.007194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.024912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:04.030639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:04.031519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:04.032308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:04.035392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 116/226] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:04.041900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.060929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.061497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.061964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.062245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.062923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:04.063228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.064661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.095512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 111/227] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:04.102138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.158369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f5f-f336-444f-84c8-1592562306ef None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.206859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.207848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.209356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.210605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.212473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:04.215204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.216998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.240916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 117/228] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:04.245155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:04.262714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.371364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a4ba-2902-4b57-a7a9-2ff206c56c31 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.413523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399d3a0-8644-4cb9-86c8-81248416b13a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.422608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:04.441935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.442574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.442849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.443115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.444267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.446095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.447782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 112/229] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:04 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:04.456601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.457589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.457937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.458281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.458806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.460277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.463226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.465440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 118/230] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:04 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:04.471596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.549331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:04.587896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3df715-c7f6-4c55-ad1a-bcef06acc8c2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.627899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.628459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.628741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.629060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.630196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.631715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.634191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 119/231] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:04 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:04.640566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.689821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6522-ede7-4338-b462-4a1c384b10f7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.758187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8311c-6f7a-43ad-9f46-53525081a037 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:04.773837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.774485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.774759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.775025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.781676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.783344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.785135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 113/232] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:04 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:04.791380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:04.794140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:04.794863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:04.795148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:04.795419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/users/944fc39083a34d6888617d4e6c4c7e46/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:04.797756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, user_id=944fc39083a34d6888617d4e6c4c7e46, role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:04.799568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1205-25c4-4345-80f2-9818ac01c0a6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:04.801950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:04.818037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 120/233] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:04 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/users/944fc39083a34d6888617d4e6c4c7e46/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:36:04.902260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:04.957993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7fb3b-f096-400b-a164-0b6ede0d555e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:05.006470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:05.007273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.007557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.007834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/users/944fc39083a34d6888617d4e6c4c7e46/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.014589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, user_id=944fc39083a34d6888617d4e6c4c7e46, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:05.016148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4cd8e-62fc-4d22-837e-81e654d82461 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:05.043580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 114/234] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:04 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/users/944fc39083a34d6888617d4e6c4c7e46/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:36:05.115118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda447d-f726-4336-8d9c-0b6677ea8f7f None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.115786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda447d-f726-4336-8d9c-0b6677ea8f7f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.115786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda447d-f726-4336-8d9c-0b6677ea8f7f None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.117684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 121/235] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:05.123792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecb1e-4f42-4b4d-9939-ccd2f2818230 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.124136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecb1e-4f42-4b4d-9939-ccd2f2818230 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.124469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecb1e-4f42-4b4d-9939-ccd2f2818230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.145627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ab2ecb1e-4f42-4b4d-9939-ccd2f2818230 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:05.146922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ab2ecb1e-4f42-4b4d-9939-ccd2f2818230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:05.227623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 115/236] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:05.248596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196290ea-dcfc-4331-9156-eedcf393e2e9 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.248926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196290ea-dcfc-4331-9156-eedcf393e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.249231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196290ea-dcfc-4331-9156-eedcf393e2e9 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.250749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 122/237] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:05.256121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.256414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.256695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.275515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:05.276719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:05.326293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:05.348693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 116/238] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:05.564674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196290ea-dcfc-4331-9156-eedcf393e2e9 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:05.669407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:05.712104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196290ea-dcfc-4331-9156-eedcf393e2e9 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:05.790212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077ec2a-0878-431e-bd4c-72c2dd6f745c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:05.798623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:05.799569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.800046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.800533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.801907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:05.803554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:05.813413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 123/239] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:05.818460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:05.835891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:05.836833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.837146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.837424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.862433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a514528f-d314-461b-88bf-462829f260f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:05.867585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:05.868472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:05.869304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 117/240] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:05.870432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8300e2-e156-46c1-9db4-0e74cc63cab9 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.870432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8300e2-e156-46c1-9db4-0e74cc63cab9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.872017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8300e2-e156-46c1-9db4-0e74cc63cab9 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.873674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 118/241] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:05.874419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8300e2-e156-46c1-9db4-0e74cc63cab9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:05.894527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:05.939065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:05.944109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2d37-8dd6-4195-99cb-036d6034be6f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:05.982212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:05.982962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:05.983410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:05.983784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:05.984563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:05.986172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4590-3ae6-4113-8a6e-40b8017aee44 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.011678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8300e2-e156-46c1-9db4-0e74cc63cab9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.012396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 124/242] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:05 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:36:06.019282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.019876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.021305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.060196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:06.063175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:06.090300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.092627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.093423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.095287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.096264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:06.097147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:06.101371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.127255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 119/243] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:06.138751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.216998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 125/244] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:06.266650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23807c8-c8fe-40f0-8466-38d67caceca6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.269498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:06.301570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.302212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.302493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.302766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] PATH_INFO: `/v3/users/3eb2679feb484781bd6b1dc5d85f85e1` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.317181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] RBAC: Authorizing `identity:get_user(user_id=3eb2679feb484781bd6b1dc5d85f85e1)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:06.318657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.320676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 120/245] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/users/3eb2679feb484781bd6b1dc5d85f85e1 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:06.326550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.381821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:06.444629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1396597-a171-4a99-81e0-92d9255f6801 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.483833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.484456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.484736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.485031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.562483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:06.565022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.565136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.617513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:06.672354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 126/246] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:06.678547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.697847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33ba4c-807f-498e-a623-7790941b1a81 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.736999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.737964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.738385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.738797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.750771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:06.755982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:06.757092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:06.758180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:06.760312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 121/247] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:06.776590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.794036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3955-0a21-4849-b294-1762b6a5d74f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.808728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:06.839649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.840541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.841038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.841548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.842954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:06.845417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.852992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 127/248] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:06.854230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:06.885440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:06.919182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461e1b-574b-40bd-9192-03344e90f084 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.965980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec79c-a716-41f3-9a85-e248c36e0619 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:06.985699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:06.986336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:06.986603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:06.986877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:06.987550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:06.987852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:06.989267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:06.998583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 122/249] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:07.008606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:07.009171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:07.010027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.010501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.010965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.011978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=3eb2679feb484781bd6b1dc5d85f85e1) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:07.012501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:07.014308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:07.020954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 128/250] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:06 2022] GET /identity/v3/role_assignments?user.id=3eb2679feb484781bd6b1dc5d85f85e1&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:07.153565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:07.173213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b05c-d348-4593-83e1-697b55f3198b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:07.226683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:07.227334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.227607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.227873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] PATH_INFO: `/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.229069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a35d36bbc47f691c8dad3a2148a7b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:07.230559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180438e6-16ac-42ad-8db4-e16947d1604b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:07.232639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 123/251] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:07 2022] GET /identity/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:07.238338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:07.349602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:07.372571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5113e4-a50c-4740-82b7-a30ba2428828 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:07.393316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009f71-4cf1-4c28-81a8-da57d7a926e9 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.393916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009f71-4cf1-4c28-81a8-da57d7a926e9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.394414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009f71-4cf1-4c28-81a8-da57d7a926e9 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.396185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 124/252] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:07.401426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.401979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.402436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.421858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:07.422561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:07.423255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.423534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.423804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.424201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:07.424992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:07.426594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205232b-4ae1-470d-bb52-39916fa191f4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:07.428365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 129/253] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:07 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:07.429499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bf7db-c864-4325-bef7-5802b33371a5 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.429778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bf7db-c864-4325-bef7-5802b33371a5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.430045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bf7db-c864-4325-bef7-5802b33371a5 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.436002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 130/254] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:07.436714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.437029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.437305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.468538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:07.470131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:07.549128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 125/255] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:07.550259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:07.672666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 131/256] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:07.681003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:07.707968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c2ba-a67e-4012-9c08-c522e7f8f0c8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:07.756420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:07.757281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:07.757567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:07.757845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/users/fe6a35d36bbc47f691c8dad3a2148a7b/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:07.762230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, user_id=fe6a35d36bbc47f691c8dad3a2148a7b, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:07.763700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:07.783002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 126/257] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:07 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/users/fe6a35d36bbc47f691c8dad3a2148a7b/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:08.047185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.122271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.132509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:08.166880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7c002-c327-4d75-94e3-893da7845d5a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.226319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.226939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.227221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.227488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.242146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:08.247117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:08.248003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:08.248798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:08.253484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 132/258] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:08.269560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.278781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57274f1-b46b-441b-81ff-976d2893804f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.353788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.354359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.354642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.354919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.370211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:08.383400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:08.384309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:08.385152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 127/259] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:08.393338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.403628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:08.422561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4dd0-77e0-43df-bdc3-7bd3de2581b7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.549695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.550762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.551248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.551738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.552608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:08.553130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:08.554820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:08.565302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:08.572930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 133/260] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:08.578690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.578965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7f3f9-47a1-44d5-90ff-0791660153a1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.645738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.646265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.646537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.646804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.647466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:08.647933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:08.649385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:08.670901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 128/261] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:08.674286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.781329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:08.826416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dea7b-82ed-4978-84a0-f3d1a70afd98 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.827437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d789a6-4836-4c07-b40b-b6c4e09ab62e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:08.880013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.880944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.881389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.881807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.885664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:08.887362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:08.889516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 129/262] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:08.894685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:08.909876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:08.910550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:08.910914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:08.911267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] PATH_INFO: `/v3/users/944fc39083a34d6888617d4e6c4c7e46` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:08.912690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] RBAC: Authorizing `identity:get_user(user_id=944fc39083a34d6888617d4e6c4c7e46)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:08.914550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:08.916681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 134/263] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/users/944fc39083a34d6888617d4e6c4c7e46 => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:08.934036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:09.039839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8939-1dd5-499b-8cef-9381759e6539 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:09.072995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.079694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.093699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:09.094448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.094793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.095136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.100088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57aff-e4af-4fd9-8cfb-a088ed2eb841 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:09.140361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:09.141009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.141619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.141892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.224151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:09.226365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12cfcc-5817-43c2-8da7-95290ec4ea17 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:09.271548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:09.275402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a50a2b-6caf-4291-9b05-658af7ba7e17 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:09.397327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.410945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 130/264] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:36:09.412221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269418-7bad-4cc9-a4a0-0a001633ed4a None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.412508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269418-7bad-4cc9-a4a0-0a001633ed4a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.418902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269418-7bad-4cc9-a4a0-0a001633ed4a None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.421949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 131/265] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:09.422803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269418-7bad-4cc9-a4a0-0a001633ed4a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:09.471272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.472812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 135/266] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:36:09.474133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.474965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.478572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.512441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:09.517772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:09.588317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269418-7bad-4cc9-a4a0-0a001633ed4a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:09.614224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 136/267] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:09.615296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:09.633387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:09.634919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.635381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.635856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.637185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:09.639720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f75bbe-1557-4095-86c8-5a4638965f3b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:09.642634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 132/268] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:09 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:09.644272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784f3a6-0a9f-49d0-b6ae-7e707224ba13 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.644771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784f3a6-0a9f-49d0-b6ae-7e707224ba13 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.645269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784f3a6-0a9f-49d0-b6ae-7e707224ba13 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.646819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 133/269] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:09.648229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2242a4-2975-4776-810a-3138ed54cf42 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.648696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2242a4-2975-4776-810a-3138ed54cf42 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.649190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2242a4-2975-4776-810a-3138ed54cf42 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.651471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 134/270] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:09.652561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2242a4-2975-4776-810a-3138ed54cf42 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:09.731741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.735635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600acb-e90e-4107-91c3-3adbbdd95d05 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:09.773140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:09.774257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.774714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.775367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.776677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:09.778569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75361b6-0e88-46e4-b39d-976195804bf7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:09.780633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 137/271] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:09 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:09.782066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.782545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.783069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.783683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:09.787333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2242a4-2975-4776-810a-3138ed54cf42 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:09.805302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:09.806935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:09.828446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:09.829087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.829368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.829676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.831217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=944fc39083a34d6888617d4e6c4c7e46) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:09.831528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:09.833286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa7b68-ebfa-417f-b930-30d39f459a09 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:09.841745 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 135/272] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:09 2022] GET /identity/v3/role_assignments?user.id=944fc39083a34d6888617d4e6c4c7e46&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:09.848665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:09.848665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:09.848665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:09.867530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:09.867530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:09.909113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 138/273] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:09.910010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:09.945379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 136/274] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:09.946351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.053894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.059233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.068184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c1b2-b400-4e96-8ace-6b3d0e0f4fbc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.071199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd02a7b-201e-4b2a-b7d4-efa4092a56a3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.109141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.109884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.110164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.110433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.131453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:10.142773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.143393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.143668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.143937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.144678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=944fc39083a34d6888617d4e6c4c7e46) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:10.145005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.146463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:10.146726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:10.147573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:10.148365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:10.149598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 137/275] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:10.155949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.163055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 139/276] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:09 2022] GET /identity/v3/role_assignments?user.id=944fc39083a34d6888617d4e6c4c7e46&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:10.277415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e34af1-bbc9-4fba-9da3-e47ab378bbf8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.296991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.333814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.335087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.335526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.335802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.336475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:10.336772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.338212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.347827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 138/277] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:10.353824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.384425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.419999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f8cd-892c-4381-8c76-384937b4233c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.460446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.461719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.462203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.462675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.464154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.467111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.469445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 140/278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:10.470510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.498311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976c37-37a7-4fa1-bf42-e395af9e9f4c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.503115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.535886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.536523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.537366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.537629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] PATH_INFO: `/v3/users/8023f00d12ce45d3b3edd55569518f5a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.555490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] RBAC: Authorizing `identity:get_user(user_id=8023f00d12ce45d3b3edd55569518f5a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.557175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.559037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 139/279] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/users/8023f00d12ce45d3b3edd55569518f5a => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:10.559604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.603322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb36b-0f09-42f8-8b31-ccb7dde6445a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.639634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.640256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.640531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.640799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.641828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.651400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:10.656666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:10.657590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 141/280] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:10.658582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.669118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e769e-16f2-43c1-a4dc-cce0ef4a244c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.702133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.702726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.702985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.703233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.703867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.705653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79312404-d246-4542-a2fe-04b21fe50404 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.726435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 140/281] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:10 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:10.727653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a81e-4b60-4ff6-8890-5ffbb7431041 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.727942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a81e-4b60-4ff6-8890-5ffbb7431041 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.728222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a81e-4b60-4ff6-8890-5ffbb7431041 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.729695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 141/282] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:10.730241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a81e-4b60-4ff6-8890-5ffbb7431041 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:10.749780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.765319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603bdb-1723-4f66-9c54-ed9c6a13df9e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.803762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.804416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.805050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.805050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.805730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, user.id=8023f00d12ce45d3b3edd55569518f5a, scope.system=all) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:10.806118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.807642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d763-e2c2-4279-a658-c4d1e42fdf19 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.813246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 142/283] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/role_assignments?user.id=8023f00d12ce45d3b3edd55569518f5a&scope.system=all&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:10.814500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.814787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.815057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.836406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:10.837751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:10.884607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a81e-4b60-4ff6-8890-5ffbb7431041 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:10.927139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:10.929263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 143/284] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:10.936045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:10.939534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:10.939534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:10.939534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:10.939534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:10.939534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:10.940543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:10.951480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 142/285] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:10.958340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.057703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:11.079332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36eecb-b463-444d-bfc9-3da353b88a2b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.116877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.117557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.117834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.118105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] PATH_INFO: `/v3/users/3eb2679feb484781bd6b1dc5d85f85e1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.119260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] RBAC: Authorizing `identity:get_user(user_id=3eb2679feb484781bd6b1dc5d85f85e1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:11.120698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:11.122639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 144/286] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:10 2022] GET /identity/v3/users/3eb2679feb484781bd6b1dc5d85f85e1 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:11.128243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.206375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.247825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b195-b41e-40e2-b8ec-a16d8560df66 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.294113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.295021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.295304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.295578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.297485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:11.303054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:11.305351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 143/287] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:11 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:11.311179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.333702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75e30-2109-451e-ae44-71779effa069 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.374147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:11.379904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.381493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.383674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.384208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.406202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:11.416199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:11.417181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:11.417954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:11.429098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 145/288] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:11.434684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.460171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:11.471713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a7ea-5250-4cfe-b8e2-0bd08c8078bd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.560988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.561931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.562206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.562476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/users/3eb2679feb484781bd6b1dc5d85f85e1/roles/ecef4df8fae44483bc5db6a2527c7ba3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.565781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, user_id=3eb2679feb484781bd6b1dc5d85f85e1, role_id=ecef4df8fae44483bc5db6a2527c7ba3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:11.567246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:11.589428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51613f3-8eee-420b-b684-41415d707f25 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.599327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 144/289] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:11 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/users/3eb2679feb484781bd6b1dc5d85f85e1/roles/ecef4df8fae44483bc5db6a2527c7ba3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:11.628898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.629564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.629848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.630117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.630803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:11.631109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:11.632675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:11.643378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:11.650340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.811329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c822c-0989-47b0-a0a7-e948d832dd71 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:11.833398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:11.848855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:11.849752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:11.850211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:11.850665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] PATH_INFO: `/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:11.852265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a35d36bbc47f691c8dad3a2148a7b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:11.853865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:11.855885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 145/291] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:11 2022] GET /identity/v3/users/fe6a35d36bbc47f691c8dad3a2148a7b => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:11.861322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:11.935251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:11.975333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a151-a429-447a-91de-5bac5785b3b9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:12.022642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:12.023506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:12.023950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:12.024354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:12.113190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:12.114879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:12.191762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:12.224238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:12.234144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:12.365024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68574-aeda-4aae-b794-97c8972194c1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:12.410582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:12.411227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:12.411503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:12.411829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:12.413753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:12.415215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d30e5-031b-4e65-ac54-bb1fff1acc6b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:12.416876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:12 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:12.422973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:12.564751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f035-53dd-463d-b773-4094c69582c7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:12.600506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:12.601268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:12.601564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:12.601833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:12.602551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=fe6a35d36bbc47f691c8dad3a2148a7b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:12.602852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:12.604282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d35631-0a82-40de-9d84-317bca9191a4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:12.611055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:12 2022] GET /identity/v3/role_assignments?user.id=fe6a35d36bbc47f691c8dad3a2148a7b&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:13.034700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936774ff-1205-49bc-abd1-1b7ee4e05d7d None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.035102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936774ff-1205-49bc-abd1-1b7ee4e05d7d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.035279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936774ff-1205-49bc-abd1-1b7ee4e05d7d None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.036861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 147/295] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:13.043156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecce68-c755-449f-88a2-b773c3a6dc60 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.043440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecce68-c755-449f-88a2-b773c3a6dc60 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.043715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecce68-c755-449f-88a2-b773c3a6dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.049030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbbcb-1fce-4c0e-83b0-4b653b067944 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.049312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbbcb-1fce-4c0e-83b0-4b653b067944 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.049583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbbcb-1fce-4c0e-83b0-4b653b067944 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.051169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 148/296] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:13.057433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecdde5-b72d-4752-80dc-a93b37ef03c7 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.057711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecdde5-b72d-4752-80dc-a93b37ef03c7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.057976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecdde5-b72d-4752-80dc-a93b37ef03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.075583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b4ecce68-c755-449f-88a2-b773c3a6dc60 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:13.076772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b4ecce68-c755-449f-88a2-b773c3a6dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:13.088808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c1ecdde5-b72d-4752-80dc-a93b37ef03c7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:13.090348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c1ecdde5-b72d-4752-80dc-a93b37ef03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:13.111547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.166564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 149/297] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:13.167497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.187445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 149/298] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:13.366823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769484-bc2d-4668-b9fb-ba4edfe1804a None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.367513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769484-bc2d-4668-b9fb-ba4edfe1804a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.367991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769484-bc2d-4668-b9fb-ba4edfe1804a None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.369673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 150/299] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:13.374972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690863f4-fb54-4d43-841d-b70985917535 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.375829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690863f4-fb54-4d43-841d-b70985917535 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.376297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690863f4-fb54-4d43-841d-b70985917535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.395312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-690863f4-fb54-4d43-841d-b70985917535 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:13.396752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-690863f4-fb54-4d43-841d-b70985917535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:13.436713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769484-bc2d-4668-b9fb-ba4edfe1804a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.469521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 150/300] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:13.476991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690863f4-fb54-4d43-841d-b70985917535 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.558743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769484-bc2d-4668-b9fb-ba4edfe1804a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.597903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:13.598541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.598821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.599092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.610408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:13.615376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:13.616390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:13.617431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:13.618033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690863f4-fb54-4d43-841d-b70985917535 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.618106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 151/301] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:13.623923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.639428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.657848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:13.658622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.658998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.659393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.663861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.671536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:13.676561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:13.677649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:13.678620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:13.680503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 151/302] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:13.686263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.759626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737824d-5a53-467e-8524-be6006066b1a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.794868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:13.795480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.795759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.796026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.796687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:13.797015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:13.798401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:13.805223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d5a0-14f7-4193-8203-8cc2482834a8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.812846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 152/303] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:13.812846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.848524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:13.849166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.849442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.849720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.850393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:13.850763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:13.852154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:13.862295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 152/304] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:13.865838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:13.904091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.918900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:13.935223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665733d-f9cf-4f47-b0d0-fdce27fdc531 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.969242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f07c-4a6d-45cb-b1da-8f361fb73234 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:13.974365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:13.975059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:13.975345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:13.975677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:13.976833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:13.978320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:13.980217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 153/305] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:13.981013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.005937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.006526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.006854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.007126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] PATH_INFO: `/v3/users/aab873c25f784e34a632708f741c5244` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.021033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] RBAC: Authorizing `identity:get_user(user_id=aab873c25f784e34a632708f741c5244)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:14.022599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:14.029065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 153/306] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/users/aab873c25f784e34a632708f741c5244 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:14.029065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.093655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af7ae-f532-4255-bb0c-0b1ee8e33edd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:14.126057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.126687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.126962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.127520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] PATH_INFO: `/v3/users/8023f00d12ce45d3b3edd55569518f5a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.128299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] RBAC: Authorizing `identity:get_user(user_id=8023f00d12ce45d3b3edd55569518f5a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:14.129760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:14.130340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:14.131503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 154/307] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:13 2022] GET /identity/v3/users/8023f00d12ce45d3b3edd55569518f5a => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:14.132149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.138808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7482ce-328c-4ce4-9d73-12ee10aeff7a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:14.157723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:14.173672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.174284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.174557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.174826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] PATH_INFO: `/v3/groups` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.175448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:14.176881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78424df9-8bf4-41dd-ad78-dcd54a229bdc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:14.193488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 154/308] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Aug 30 11:36:14 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:14.194901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e836a-dee4-4f08-9b2a-60a75adfa2e7 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.195379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e836a-dee4-4f08-9b2a-60a75adfa2e7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.195653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e836a-dee4-4f08-9b2a-60a75adfa2e7 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.197058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 155/309] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:14.197655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e836a-dee4-4f08-9b2a-60a75adfa2e7 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.243705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23d3a-559b-4cc4-a7b0-04c7b693e960 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:14.284564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.285238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.285506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.285775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.286518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, user.id=aab873c25f784e34a632708f741c5244, scope.system=all) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:14.286851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:14.288328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d99ba5-24c8-429d-aeef-a69272996c04 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:14.303488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 155/310] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 11:36:14 2022] GET /identity/v3/role_assignments?user.id=aab873c25f784e34a632708f741c5244&scope.system=all&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:14.303488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.303488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.303488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.319638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:14.320794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:14.331124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e836a-dee4-4f08-9b2a-60a75adfa2e7 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:14.377709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.378430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.378903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.379234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] PATH_INFO: `/v3/system/users/8023f00d12ce45d3b3edd55569518f5a/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.380844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8023f00d12ce45d3b3edd55569518f5a, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:14.383029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:14.399896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 156/311] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Aug 30 11:36:14 2022] PUT /identity/v3/system/users/8023f00d12ce45d3b3edd55569518f5a/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:14.420792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 156/312] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:14.702014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.726166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:14.810892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943693ac-2d36-4f27-8c3f-bce4aa7447db None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:14.845061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:14.845694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:14.845969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:14.846237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:14.861088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:14.866493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:14.867354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:14.868142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:14.873681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:14.892475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:14.980939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59a858-65de-40e6-bd0c-754441cb9692 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:15.020705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:15.020705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:15.020705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:15.020705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:15.021068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:15.021068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:15.021068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:15.032292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 157/314] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:15.034916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:15.115814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:15.139767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa58ec-8d19-4a07-96d6-dca8c2d2fb58 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:15.173387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:15.174362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:15.174847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:15.175307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] PATH_INFO: `/v3/users/3eb2679feb484781bd6b1dc5d85f85e1` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:15.176703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] RBAC: Authorizing `identity:get_user(user_id=3eb2679feb484781bd6b1dc5d85f85e1)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:15.178850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:15.181170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 158/315] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:15 2022] GET /identity/v3/users/3eb2679feb484781bd6b1dc5d85f85e1 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:15.187074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:15.269392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:15.289283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed411a-cf00-4f3e-9ca4-bf91b7c9db6e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:15.324134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:15.325161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:15.325680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:15.326157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:15.395627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:15.397578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:15.482001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:15.503563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:15.509642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:15.609051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25aea9-d0b9-445f-95ee-d24800258177 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:15.641969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:15.642593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:15.642867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:15.643136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:15.644283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:15.645804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a0c4-e170-4316-b010-674983c985d1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:15.647465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 159/317] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:15 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:15.653480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:15.752426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8adb-a418-447c-be46-f8422f367bbd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:15.786153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:15.786767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:15.787046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:15.787319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:15.788071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, scope.project.id=4d58411542354cf29d4588108234a14a, user.id=3eb2679feb484781bd6b1dc5d85f85e1) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:15.788382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:15.789832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b5a12-6d62-403d-99db-e3920e988801 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:15.796133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 159/318] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:15 2022] GET /identity/v3/role_assignments?user.id=3eb2679feb484781bd6b1dc5d85f85e1&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:16.266571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7925ae-2237-4875-a36e-eb9bd0aaa415 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.266975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7925ae-2237-4875-a36e-eb9bd0aaa415 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.267172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7925ae-2237-4875-a36e-eb9bd0aaa415 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.268615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 160/319] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:16.273965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1677f-9329-443c-9a23-f1af88f7551f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.274434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1677f-9329-443c-9a23-f1af88f7551f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.274506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1677f-9329-443c-9a23-f1af88f7551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.294023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-84a1677f-9329-443c-9a23-f1af88f7551f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:16.295210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-84a1677f-9329-443c-9a23-f1af88f7551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:16.319135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9653-bee1-48db-8e00-72cb8f462bd7 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.319470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9653-bee1-48db-8e00-72cb8f462bd7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.320352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9653-bee1-48db-8e00-72cb8f462bd7 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.321712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 161/320] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:36:16.326573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.326856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.327130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.339916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:16.348039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:16.350181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:16.363439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:16.371635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 160/321] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:16.371635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999a4b-14db-46ce-b7dc-446c4f031e80 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.371635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999a4b-14db-46ce-b7dc-446c4f031e80 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.371635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999a4b-14db-46ce-b7dc-446c4f031e80 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.371635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 161/322] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:16.379646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.379940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.380192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.398711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:16.399889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:16.427624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 162/323] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:16.466955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 162/324] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:16.633921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:16.698943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:16.744733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39802af-2360-4169-88e6-23603d7aed77 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:16.779328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:16.779963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.780237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.780502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.791282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:16.796138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:16.797055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:16.797848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 163/325] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:16.798501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:16.804383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ec35-9039-41ee-b96f-f66d6ddab01c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:16.808213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:16.808846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:16.846937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:16.847581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.848180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.848569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.849991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:16.851780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:16.853455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 163/326] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:16.854253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:16.919912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933acf-89d1-4b3d-a407-b7bbde8a7723 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:16.954545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a247-d998-4276-905c-927a7003e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:16.955584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a247-d998-4276-905c-927a7003e07a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.955923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a247-d998-4276-905c-927a7003e07a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.956261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a247-d998-4276-905c-927a7003e07a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.958096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f70874-dfd5-4c50-960f-71eda498d818 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:16.967034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a247-d998-4276-905c-927a7003e07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-d966a247-d998-4276-905c-927a7003e07a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:16.971824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:16.972943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 164/327] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:16.974167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a247-d998-4276-905c-927a7003e07a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:16.995719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:16.996330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:16.996613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:16.996884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:16.997573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] RBAC: Adding query filter params (name=reader) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:16.997876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:16.999257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.007471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 164/328] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:17.008244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:17.039852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:17.045503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:17.074956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a247-d998-4276-905c-927a7003e07a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.108811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.109447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.109726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.110026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] PATH_INFO: `/v3/groups` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.110642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.111865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f415e-3f9c-4e96-a285-f072387639af None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.112124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.127382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 165/329] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Aug 30 11:36:16 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:17.128159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:17.149359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.149997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.150279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.150556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.151240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:17.151548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.153141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.163175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 165/330] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:17.168882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:17.245781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eea61-288c-431b-8bec-419ceaf33208 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.275335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:17.276271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:17.286002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7656-900a-43b7-af55-ea7e4cd93c5b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.290877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.291529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.291802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.292068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] PATH_INFO: `/v3/users/aab873c25f784e34a632708f741c5244` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.293770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] RBAC: Authorizing `identity:get_user(user_id=aab873c25f784e34a632708f741c5244)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.295213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.297420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 166/331] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:17 2022] GET /identity/v3/users/aab873c25f784e34a632708f741c5244 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:17.303513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:17.328155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.328356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.328594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.328885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] PATH_INFO: `/v3/users/8023f00d12ce45d3b3edd55569518f5a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.330037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] RBAC: Authorizing `identity:get_user(user_id=8023f00d12ce45d3b3edd55569518f5a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.331793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.333717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 166/332] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:17 2022] GET /identity/v3/users/8023f00d12ce45d3b3edd55569518f5a => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:17.340311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:17.426984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f6808-0b8b-450e-8eba-82318d95b998 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.461145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5d69-62c9-4eb0-b6c3-a5b728a6fabe None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:17.466465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.467176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.467451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.467717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] PATH_INFO: `/v3/system/users/aab873c25f784e34a632708f741c5244/roles/ecef4df8fae44483bc5db6a2527c7ba3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.469158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aab873c25f784e34a632708f741c5244, role_id=ecef4df8fae44483bc5db6a2527c7ba3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.470659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ab70-51ff-4015-9c90-0939a000ec62 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.481034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Aug 30 11:36:17 2022] PUT /identity/v3/system/users/aab873c25f784e34a632708f741c5244/roles/ecef4df8fae44483bc5db6a2527c7ba3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:36:17.512451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:17.513142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:17.513498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:17.513866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:17.514720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] RBAC: Adding query filter params (role.id=4f141bfba90347c9bd6a2851ea2e615c, user.id=8023f00d12ce45d3b3edd55569518f5a, scope.system=all) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:17.515055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:17.516599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916e812-f31d-43bd-9927-4f2a71a59bda None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:17.531122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 167/334] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 11:36:17 2022] GET /identity/v3/role_assignments?user.id=8023f00d12ce45d3b3edd55569518f5a&scope.system=all&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:19.194846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5b50-a9a2-45d5-9239-e7a5ab1ce8bd None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:19.195363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5b50-a9a2-45d5-9239-e7a5ab1ce8bd None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:19.195363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5b50-a9a2-45d5-9239-e7a5ab1ce8bd None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:19.196917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 168/335] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:19.202553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1cd27-b96e-4d36-abd1-b80cc75345e4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:19.203426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1cd27-b96e-4d36-abd1-b80cc75345e4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:19.203908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1cd27-b96e-4d36-abd1-b80cc75345e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:19.225524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3dc1cd27-b96e-4d36-abd1-b80cc75345e4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:19.227041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3dc1cd27-b96e-4d36-abd1-b80cc75345e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:19.246326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:19.306617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 168/336] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:19.561669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368e4-1764-4b25-bbcf-e8594534942b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:19.562480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368e4-1764-4b25-bbcf-e8594534942b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:19.563083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368e4-1764-4b25-bbcf-e8594534942b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:19.564908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 169/337] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:19.570892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:19.571181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:19.571458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:19.592737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:19.594016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:19.649016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612368e4-1764-4b25-bbcf-e8594534942b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:19.681592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 169/338] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:19.731937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:19.783754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612368e4-1764-4b25-bbcf-e8594534942b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:19.828336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:19.829060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:19.829340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:19.829611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:19.844382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:19.849977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:19.850905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:19.852064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 170/339] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:19.859391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:19.967924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:19.988384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc3512-43ec-47a3-83ec-d13a96ce3d68 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.029295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:20.029954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.030234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.030504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.031178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:20.031528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:20.032911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb144-dd89-44c9-8c50-9e37461690eb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:20.043505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 170/340] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:20.049336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.052106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ebe1-7c06-4469-8b02-d4e7e3b292d9 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.052106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ebe1-7c06-4469-8b02-d4e7e3b292d9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.052106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ebe1-7c06-4469-8b02-d4e7e3b292d9 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.054443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 171/341] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:20.063308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6274-fbf3-44e2-8d73-227d04c4acdb None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.063590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6274-fbf3-44e2-8d73-227d04c4acdb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.063920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6274-fbf3-44e2-8d73-227d04c4acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.087032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7a0e6274-fbf3-44e2-8d73-227d04c4acdb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:20.088230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7a0e6274-fbf3-44e2-8d73-227d04c4acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:20.201777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e594-999e-4dfb-b4b0-dc34458a43ce None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.202700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 172/342] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:20.204013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f6b2-7534-4ce4-aed9-0793312030ca None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.204304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f6b2-7534-4ce4-aed9-0793312030ca None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.204576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f6b2-7534-4ce4-aed9-0793312030ca None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.206425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 173/343] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:20.207229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f6b2-7534-4ce4-aed9-0793312030ca None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.219906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.254609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:20.255244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.255524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.255797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.313483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.334478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f6b2-7534-4ce4-aed9-0793312030ca None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.376276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:20.377322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.377802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.378243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.391708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6e7891fd-e089-4235-983a-90ba5b1a232c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:20.397627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:20.398526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:20.399349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:20.401538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 174/344] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:20.403707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.404137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.404547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.425509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:20.427229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:20.459020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:20.460811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:20.516491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 175/345] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:20.517653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.593063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.640286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb68a-b168-4ee4-8cca-69f94e4defb4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.679320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 171/346] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:20.680578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.693841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:20.694918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.695529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.695966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.698432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:20.698911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:20.700440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:20.713838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.720349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 176/347] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:20.721229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.810995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6073d-eed8-489c-ab23-da090bb127c7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.850939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:20.851949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:20.852374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:20.852781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:20.865163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:20.870822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:20.872003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:20.873035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:20.875367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 172/348] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:20.876473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:20.968954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1c372-f120-4414-9852-aed48da4542a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:20.970680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.995953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:20.996380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c74e6-9193-4eb6-b8e2-a47e90b689dc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.005786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.006402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.006744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.007151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.008293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.009776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.011467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 177/349] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.012159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.035567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.036525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.036961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.037393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.110333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.112032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.123098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686160ee-3723-451a-b9be-13645ebd1ab8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.158066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.158678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.159013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.159213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.159876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] RBAC: Adding query filter params (name=member) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:21.160161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.161583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.170164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 178/350] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.171056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.194472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.219893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 173/351] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:21.221481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.234729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.282527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e62d-79c0-49a8-8ca5-63b96ab1c3ce None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.326763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998dcd-2cdf-4e1e-bfd8-77a59616d3f1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.330619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.331129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.331406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.331671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.345137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:21.350729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:21.351800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 179/352] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:21.352787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.382726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.383662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.384109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.384603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.392315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.394204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.396332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 174/353] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.397337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.457125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.488017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa378-26c4-40d2-a444-a8fd3bc4e729 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.502920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.523973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.524882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.525184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.525452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.532549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124aca4-c142-49bf-abc4-72e9c1e5ec3e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.577463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.578095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.578367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.578635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.580936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.582413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.584240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 175/354] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.586489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.608108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.609949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e50eac-318a-404e-afe2-62179cd7a474 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.740309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 180/355] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:21.740778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cf49-8ad1-4e6e-980e-1572874bcbf2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.746397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ffad-5eb0-4e9e-bb22-687ebb7a7af5 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.746686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ffad-5eb0-4e9e-bb22-687ebb7a7af5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.746954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ffad-5eb0-4e9e-bb22-687ebb7a7af5 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.749237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 181/356] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:21.749963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ffad-5eb0-4e9e-bb22-687ebb7a7af5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.754243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.778606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:21.788944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.789591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.789871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.790145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.790817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:21.791125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.792508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.804392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 176/357] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.805273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.895621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ffad-5eb0-4e9e-bb22-687ebb7a7af5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.927247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add0-25ba-4cd2-86dd-5411f0088f1e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:21.937917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.938535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.938808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.939074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.939792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=dbf5da46264042c49bfb291ea9edf81a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:21.940098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.941557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.949023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 182/358] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.949902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:21.972223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:21.972875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.973222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.973495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:21.976137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:21.977686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a226-180c-4158-8388-692d4cf370bc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:21.980442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 177/359] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:21.981526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:21.981805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:21.982074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.008334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:22.009670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:22.056497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.068134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.106336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855430-07e7-4bbf-aa61-5dd387a66753 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.107889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 178/360] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:22.108825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.145636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.146331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.146531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.146796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.148051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.150463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c46323-f9f5-4fc4-ab8e-a2128954f26a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.152208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 183/361] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:21 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:22.153301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bf89-59c9-4988-ae23-dc9fc251e65b None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.153576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bf89-59c9-4988-ae23-dc9fc251e65b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.153838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35bf89-59c9-4988-ae23-dc9fc251e65b None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.155388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 184/362] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:22.155972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bf89-59c9-4988-ae23-dc9fc251e65b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.232517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc611-7ae1-4987-a7ef-b00db9803963 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.262789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35bf89-59c9-4988-ae23-dc9fc251e65b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.271968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.273081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.273576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.274115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] PATH_INFO: `/v3/users/aab873c25f784e34a632708f741c5244` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.275447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] RBAC: Authorizing `identity:get_user(user_id=aab873c25f784e34a632708f741c5244)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.277283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb018c38-03c2-4330-b75b-31656f89c940 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.279408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 179/363] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/users/aab873c25f784e34a632708f741c5244 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:22.281005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.281474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.281926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.298478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.299092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.299369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.299639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.300370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=dbf5da46264042c49bfb291ea9edf81a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:22.300672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.302128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.308515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:22.309270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 185/364] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:22.310366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.310767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:22.326562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.348260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.396299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 180/365] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:22.397712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.422808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe25d-4ea9-4db3-a00b-6b441fdbf447 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.458376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.459026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.459300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.459566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.460763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.462226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.468740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 186/366] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:22.470370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.514242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be81b-5d44-4ddf-98e1-1edfdcee2ab2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.552320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.553105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.553847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.553847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.554762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] RBAC: Adding query filter params (role.id=ecef4df8fae44483bc5db6a2527c7ba3, user.id=aab873c25f784e34a632708f741c5244, scope.system=all) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:22.555155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.556803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.564802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.570531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 181/367] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/role_assignments?user.id=aab873c25f784e34a632708f741c5244&scope.system=all&role.id=ecef4df8fae44483bc5db6a2527c7ba3 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:22.577814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.579264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656736b7-76d3-4688-81cc-f170e180651b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.617573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.618309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.618745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.619114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.619899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=4d58411542354cf29d4588108234a14a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:22.620278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:22.621835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:22.632825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 187/368] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:22.634875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.753574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b060-7ffe-46c4-9957-be6d150af83d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:22.807793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:22.808454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:22.808731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:22.809037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:22.818655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.825152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:22.833376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:22.834483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:22.840202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 182/369] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:22.843854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:22.985356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:22.995757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc430-34f1-4217-8545-c4e8938588ba None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.028143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fc88-b8c6-4869-bde5-05e3ee671a04 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.041580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.042204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.042482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.042758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.043431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:23.043738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:23.045160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:23.054688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 183/370] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:23.060620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.073942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.074581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.074854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.075116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.088671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:23.094066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:23.094962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:23.095741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:23.096651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 188/371] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:23.103176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.125367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:23.189965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9747be3-c6af-462e-b04e-a59ce980c76b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.238582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.239336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.239509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.240265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.242147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed89202-1953-462e-a0f3-3724fe02d1b8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.283652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:23.311428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.312036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.312221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.312465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.313157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:23.316444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:23.324220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:23.337769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 189/372] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:23.343476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.374758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:23.376298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:23.460307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:23.492176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 184/373] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:23.502486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.535656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821da85-a74f-43b1-ae58-a8c6aae92a07 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.585408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:23.603780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.604772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.605239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.605672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.683449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e93c25-4d51-44e2-bb3c-93a64f89ff11 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.694895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:23.697048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:23.739402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:23.740038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:23.740369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:23.740644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:23.742138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:23.743583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:23.745660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 185/374] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:23.753672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.793348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:23.856658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 190/375] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:23.862312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:23.943431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e92d1-a584-42b5-937e-8d4d167e2198 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:23.974677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:24.006343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:24.007077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.007353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.007697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.017004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:24.018498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:24.020604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 186/376] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:24.028260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:24.061050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c6c80-e57b-40c1-a91b-99f9b7b9f532 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:24.150328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:24.150895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.151175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.151447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] PATH_INFO: `/v3/projects/3b3b177b7bdd47fbbe8d53653a263794` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.152578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] RBAC: Authorizing `identity:get_project(project_id=3b3b177b7bdd47fbbe8d53653a263794)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:24.154052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:24.156034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 191/377] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:23 2022] GET /identity/v3/projects/3b3b177b7bdd47fbbe8d53653a263794 => generated 344 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:24.158266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1a58-d42e-46ea-896b-52bff9a9237a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:24.161107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:24.201841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:24.203283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.203742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.204223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.205557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=4d58411542354cf29d4588108234a14a) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:24.206052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:24.208359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:24.221004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 187/378] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:24 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:24.238102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:24.326445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac87a3-616a-4402-96ad-aca3506ff15b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:24.370991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:24.371648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.371933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.372224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] PATH_INFO: `/v3/groups/45ad1110b2e84e2abe3952aa00ee2432` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.379088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] RBAC: Authorizing `identity:get_group(group_id=45ad1110b2e84e2abe3952aa00ee2432)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:24.380561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f2d3-8470-41dc-8a06-55552ed8568a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:24.387504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 192/379] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:24 2022] GET /identity/v3/groups/45ad1110b2e84e2abe3952aa00ee2432 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:24.388870 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:24.450665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:24.468242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d658-92e8-4535-a09e-1d2a581c0fdf None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.468555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d658-92e8-4535-a09e-1d2a581c0fdf None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.468808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d658-92e8-4535-a09e-1d2a581c0fdf None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.470183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 193/380] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:36:24.475637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a25f-e425-41fb-8e81-3786ce0d87d0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.475923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a25f-e425-41fb-8e81-3786ce0d87d0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.477110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a25f-e425-41fb-8e81-3786ce0d87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.510845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1e51a25f-e425-41fb-8e81-3786ce0d87d0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:24.512538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1e51a25f-e425-41fb-8e81-3786ce0d87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:24.531402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d0532-6617-4cdf-8117-9646df2a96f4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:24.591969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:24.592984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:24.593463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:24.593925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:24.594869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] RBAC: Adding query filter params (group.id=45ad1110b2e84e2abe3952aa00ee2432, role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3b3b177b7bdd47fbbe8d53653a263794) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:24.595371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:24.598289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:24.608652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 188/381] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:24 2022] GET /identity/v3/role_assignments?group.id=45ad1110b2e84e2abe3952aa00ee2432&scope.project.id=3b3b177b7bdd47fbbe8d53653a263794&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:24.631474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 194/382] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:25.089044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.094475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c7a0-d612-4603-a01d-82e5134798d0 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.094762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c7a0-d612-4603-a01d-82e5134798d0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.095036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c7a0-d612-4603-a01d-82e5134798d0 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.096635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 195/383] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:25.102010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03269d6d-9b3f-43a5-b529-dfe0e6209807 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.102272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03269d6d-9b3f-43a5-b529-dfe0e6209807 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.102548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03269d6d-9b3f-43a5-b529-dfe0e6209807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.121129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-03269d6d-9b3f-43a5-b529-dfe0e6209807 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:25.122301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-03269d6d-9b3f-43a5-b529-dfe0e6209807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:25.147306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:25.232319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 196/384] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:25.234442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59fb54-07a6-4aaa-84d2-1dceea80aa77 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.234829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59fb54-07a6-4aaa-84d2-1dceea80aa77 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.235365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59fb54-07a6-4aaa-84d2-1dceea80aa77 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.237276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 197/385] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:25.243387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.243774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.244142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.257331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482511-1a70-45de-9ed2-7fe5f1839ed6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:25.267433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:25.268669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:25.278775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:25.312161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:25.312839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.313157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.313429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.330943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:25.337416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:25.338531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:25.339569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 189/386] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:25.348358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.369104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 198/387] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:25.468104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342039c5-dd11-43c8-9fe8-931928d0f561 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:25.508550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:25.509202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.509483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.509759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.510434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:25.510741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:25.512128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:25.525772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 190/388] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:25.531615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.648466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:25.660606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def3750-8c0c-4b64-8277-bd394e7ce577 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:25.692603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.697916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:25.698562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.698842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.699111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.701684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:25.703186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:25.705014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 199/389] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:25.713592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.743426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:25.839821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff242-326f-4b07-ac51-74726525c31d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:25.840022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2c1d-a397-4531-af73-184964b264cf None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:25.881073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:25.882136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.882733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.883230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.883646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:25.884541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:25.884890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:25.887542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:25.888386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:25.890599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:25.892743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 200/390] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:25.897003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:25.908288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:25.914195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:25.915153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:25.915980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:25.923598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 191/391] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:25.923908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:25.924596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.025302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a177-c241-4cf6-90aa-ae0b95c78c2c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.032354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.041016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6af4-c62b-4ca7-a045-ca76c87f0e61 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.075712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.076774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.077355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.077632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.081559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.082226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.082506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.082777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.088253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, group_id=0d80bc84b38f4ae0a3d01ceeceea3b55, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.089945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.094082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:26.099353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:26.100345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:26.101187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 201/392] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:26.102579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.112584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 192/393] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 11:36:25 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:26.113292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.235604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.255147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa0f1-e9fe-485e-aac0-17a55960dbbe None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.265131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996ccb-1d7f-4957-bf07-caa768d7b0aa None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.301282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.301910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.302184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.302451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.303127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:26.303498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.304909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.320172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 202/394] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:26.320615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.322859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.322859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.322859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.322859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:26.322859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.324238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.324423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.335418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 193/395] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:26.341769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.377441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.439713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd801ae-755c-45c1-8f4c-050b56bb5bbf None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.454159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abce3-6238-41a6-8844-89a637bf4bd4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.479815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.480828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.481322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.481807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.483171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.484842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.487163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 203/396] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:26.495019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.500059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.500746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.501046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.501323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.502575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.505380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.508613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 194/397] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:26.517496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.522760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.625640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.642789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9ecc-e616-4125-ac96-69a63d434366 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.669644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf32b-f532-41d1-9a4e-e286548420d1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.679463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.680195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.680535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.680903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.682063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.683663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fff636-fbce-4ae6-96e1-3e0feeba4f62 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.685668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 195/398] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:26.686964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620a5c-d2bd-4d63-872e-2476769e4bac None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.687243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620a5c-d2bd-4d63-872e-2476769e4bac None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.687605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620a5c-d2bd-4d63-872e-2476769e4bac None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.689054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 196/399] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:26.691997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620a5c-d2bd-4d63-872e-2476769e4bac None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.723381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.724118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.724403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.724678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.726928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.728382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d4a69-7978-49d0-baf7-052f7495894c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.730621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 204/400] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:26 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:26.731873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.732195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.732469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.758575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:26.759689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:26.809703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620a5c-d2bd-4d63-872e-2476769e4bac None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:26.853519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 205/401] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:26.854785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:26.858827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:26.858827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:26.859043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:26.859262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:26.865267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, group_id=0d80bc84b38f4ae0a3d01ceeceea3b55, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:26.866789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:26.870983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:26.899623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 197/402] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 11:36:26 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:26.991966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e4b1c-82e7-43a2-9322-c26addf612f1 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:27.029277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:27.030425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.030900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.031376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.033984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5da46264042c49bfb291ea9edf81a, group_id=0d80bc84b38f4ae0a3d01ceeceea3b55, role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:27.035727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:27.057354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 206/403] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 11:36:26 2022] PUT /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:27.198111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:27.215792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:27.315003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27824d9-49bb-4d6d-a1ef-d5701675ee64 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:27.359685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:27.360324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.360590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.360855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.377853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-8140332d-efbb-433a-b84a-6dc2f739c94c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:27.383336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:27.384263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:27.385086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 198/404] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:27.392244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:27.427540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9314-d469-415c-b1c7-bf4f12f943aa None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.427862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9314-d469-415c-b1c7-bf4f12f943aa None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.428084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9314-d469-415c-b1c7-bf4f12f943aa None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.429765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 199/405] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:36:27.434627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.434906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.435173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.482005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:27.483193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:27.488274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:27.526573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56599d2-b5aa-4d02-960a-7d7de03cd375 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:27.565666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:27.566198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.566475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.566743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.567409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:27.567709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:27.569395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:27.578794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 207/406] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:27.584994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:27.635581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 200/407] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 11:36:27.692416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671613a-fedd-4886-96e9-158bc3ea1396 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:27.728038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:27.728682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.728960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.729297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.730451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:27.731907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:27.733835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 208/408] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:27 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:27.739520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:27.742719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:27.864419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120871b-bd24-4fb1-a0e4-1e416f35a047 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:27.902523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:27.903156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:27.903433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:27.903703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:27.904818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:27.906301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:27.908283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 201/409] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:27 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:27.914316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:27.919720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:28.065176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d467-7c09-4592-83da-8b0ea3079763 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:28.110656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:28.114621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:28.115231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.115511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.115825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.118062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d58411542354cf29d4588108234a14a, group_id=0d80bc84b38f4ae0a3d01ceeceea3b55, role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:28.119620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:28.146235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 209/410] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 11:36:27 2022] PUT /identity/v3/projects/4d58411542354cf29d4588108234a14a/groups/0d80bc84b38f4ae0a3d01ceeceea3b55/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:36:28.247243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:28.291317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a04e-5248-40a3-a15f-3f90caa6462e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:28.330789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:28.331431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.331706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.331975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.346938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-960827e8-615c-4667-9feb-44c52cbc061e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:28.351862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:28.352771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:28.353605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 202/411] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:28.361257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:28.429881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9422-6747-4ef3-94f7-a2bdfd0f8144 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.430566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9422-6747-4ef3-94f7-a2bdfd0f8144 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.431059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9422-6747-4ef3-94f7-a2bdfd0f8144 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.433030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 203/412] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:36:28.438632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.439148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.439612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.442181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:28.464576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:28.466287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:28.521301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e45a92-6778-4aae-adfa-2ad8dfc6db83 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:28.581888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 204/413] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:28.592219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:28.593266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.593755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.594265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.595191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:28.595696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:28.597344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:28.612436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 210/414] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:28.618375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:28.717730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:28.772753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f9a0-28ef-4964-8bd0-07a1fd2bf0e1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:28.823557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:28.824203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:28.824483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:28.824750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] PATH_INFO: `/v3/groups/45ad1110b2e84e2abe3952aa00ee2432` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:28.825916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] RBAC: Authorizing `identity:get_group(group_id=45ad1110b2e84e2abe3952aa00ee2432)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:28.827367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:28.829283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 205/415] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:28 2022] GET /identity/v3/groups/45ad1110b2e84e2abe3952aa00ee2432 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:28.835510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:28.958447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:28.968547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e7b6-79f0-4495-b4dc-c8ea0016dabb None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:29.009097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:29.031270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:29.031906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.032179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.032445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] PATH_INFO: `/v3/projects/3b3b177b7bdd47fbbe8d53653a263794` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.035290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3b177b7bdd47fbbe8d53653a263794)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:29.036747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:29.040521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 211/416] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:28 2022] GET /identity/v3/projects/3b3b177b7bdd47fbbe8d53653a263794 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:29.044788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:29.148327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554a83-ef92-41fd-93a6-8732afd9acb5 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:29.197338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:29.210736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:29.211370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.211642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.211910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.215282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085ba8-7119-4e14-aba0-a631cfebca73 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:29.232882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:29.238734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:29.239654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:29.240461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:29.245809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 206/417] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:29.249683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:29.278655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:29.279320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.279595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.279863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] PATH_INFO: `/v3/projects/3b3b177b7bdd47fbbe8d53653a263794/groups/45ad1110b2e84e2abe3952aa00ee2432/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.281767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] RBAC: Authorizing `identity:create_grant(project_id=3b3b177b7bdd47fbbe8d53653a263794, group_id=45ad1110b2e84e2abe3952aa00ee2432, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:29.283189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:29.297308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 212/418] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 11:36:29 2022] PUT /identity/v3/projects/3b3b177b7bdd47fbbe8d53653a263794/groups/45ad1110b2e84e2abe3952aa00ee2432/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:36:29.391229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db5bd-0c56-482d-9be4-515c36246221 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:29.429781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:29.430405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.430678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.430946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.431619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:29.431914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:29.433346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ea1d-9ff1-450a-9876-b60f755d0a50 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:29.452089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 207/419] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:29.453705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:29.475596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf5a9-7561-4344-9cfb-918393262d6c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.476387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf5a9-7561-4344-9cfb-918393262d6c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.476387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf5a9-7561-4344-9cfb-918393262d6c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.477524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 208/420] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:36:29.483358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7943d8-d347-492c-93ad-7dc5162e9867 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.483632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7943d8-d347-492c-93ad-7dc5162e9867 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.483962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7943d8-d347-492c-93ad-7dc5162e9867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.506886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-cb7943d8-d347-492c-93ad-7dc5162e9867 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:29.507953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cb7943d8-d347-492c-93ad-7dc5162e9867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:29.532656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:29.566496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:29.595215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 209/421] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:29.598185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af544-e56f-42b3-8cec-af0718c00143 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.598664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af544-e56f-42b3-8cec-af0718c00143 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.599121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af544-e56f-42b3-8cec-af0718c00143 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.600859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 210/422] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:29.606768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.607332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.607805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.628335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:29.630046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:29.634896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24e1d-7aa3-4174-99d6-8591dc99e22f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:29.707369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 211/423] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:29.732749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:29.733782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:29.734271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:29.734737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:29.808985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:29.810809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:29.866465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:29.911361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:29.915536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 213/424] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:29.925990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.071958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81183f0-c0d0-4471-9562-3e42a47ae309 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.098186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.101210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8484-463c-4278-94ed-0a28d59b0283 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.116828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.118052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.118500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.119175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.133696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:30.136634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.137315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.137590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.137856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.138970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:30.139685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:30.140519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:36:30.141328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:30.141915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.147111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 214/426] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:29 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:30.147237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 212/426] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:30.148022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.148406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.174529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.266333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3afe63-2712-4ca7-a0ac-ef31f89a7b13 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.284200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c57-0df0-4600-9d25-95f1cd922732 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.313701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.314425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.314993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.315335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.320896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.321756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.322247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.322668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.324106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.325733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.326845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:30.327759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 213/427] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:30.328728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:30.333512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:30.334634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:30.335598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:30.338185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 215/428] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:30.343729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.376276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.429958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.443164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e96e6-4ae6-4822-8a33-24e0bc7a2f4f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.452029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534fed-80bb-42d6-9147-85d6797b996b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.481584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.482573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.483658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.484097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.484916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] RBAC: Adding query filter params (name=member) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:30.485474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.489167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.492034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.492694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.492988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.493258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.493984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=dbf5da46264042c49bfb291ea9edf81a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:30.494284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.495812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.499901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 214/429] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:30.501087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.505628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 216/430] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:30.530126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.621155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183e49-6b7b-4f47-adc0-ae218fb8c771 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.625431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.663725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ba85b-a159-487a-9923-45880569828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.665360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba85b-a159-487a-9923-45880569828d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.665844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba85b-a159-487a-9923-45880569828d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.666311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba85b-a159-487a-9923-45880569828d None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.667172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba85b-a159-487a-9923-45880569828d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:30.667669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba85b-a159-487a-9923-45880569828d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.669591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba85b-a159-487a-9923-45880569828d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.681433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 215/431] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:30.682867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe5dc-ce57-45cd-a65b-5cc372e42525 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.683152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe5dc-ce57-45cd-a65b-5cc372e42525 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.683427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe5dc-ce57-45cd-a65b-5cc372e42525 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.684607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 216/432] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:30.687140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe5dc-ce57-45cd-a65b-5cc372e42525 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:30.727887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1921c-31a6-4848-aecc-5bcc8b17da4d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.768425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.769082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.769954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.769954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.785568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.805734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe5dc-ce57-45cd-a65b-5cc372e42525 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:30.845601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:30.846405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:30.846690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:30.846964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:30.854997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.856476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b17660-aa5b-4dee-a853-bf4537226d07 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:30.892203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:30.941149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:30.942762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.013395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 217/433] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:31.015037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.015587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.015916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.035538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:31.036902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:31.059442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 217/434] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:31.065134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.078835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.110630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 218/435] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:31.111473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.135392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.188993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7008e9-4db3-4df4-86e9-0d9708da8b93 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.220739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c159-6303-4a3c-ad19-24a20bb4b1b3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.232827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.233925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.234204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.234475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.235842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.237623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.244748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 218/436] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.246155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.267163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.267882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.268165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.268437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] PATH_INFO: `/v3/projects/dbf5da46264042c49bfb291ea9edf81a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.269760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] RBAC: Authorizing `identity:get_project(project_id=dbf5da46264042c49bfb291ea9edf81a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.271300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.273895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 219/437] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/projects/dbf5da46264042c49bfb291ea9edf81a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.283001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.337688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.373295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c467f-88bf-4413-9bff-27e17b69881e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.405358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.407683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d06ac-56ef-4a51-bc8b-4eb5848bf61f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.412046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.412735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.413177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.413447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.414541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.416013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52888ee-0974-400a-a1a9-df101db3bebf None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.417614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 219/438] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.418817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82232c2-cb71-401b-9041-475b70825e9b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.418987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82232c2-cb71-401b-9041-475b70825e9b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.419270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82232c2-cb71-401b-9041-475b70825e9b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.424554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 220/439] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:31.424554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82232c2-cb71-401b-9041-475b70825e9b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.446460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.447029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.447310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.447579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.448814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.450318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.451896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 220/440] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.452646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.531080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82232c2-cb71-401b-9041-475b70825e9b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.556089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ce6-3801-454c-a53f-f24400308a44 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.565862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.566479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.566603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.566773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.567039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.577622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-73b4166f-a0b2-4c71-8306-b7a6420f0815 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:31.582699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:31.583604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:31.584397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 221/441] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:31.585787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.585787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.585787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.590888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.591507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.591782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.592046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.592768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=4f141bfba90347c9bd6a2851ea2e615c, scope.project.id=4d58411542354cf29d4588108234a14a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:31.593096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.594513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.600261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 221/442] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=4f141bfba90347c9bd6a2851ea2e615c => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.601034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.603502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:31.604703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:31.682045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.701437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 222/443] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:31.701437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.718155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf252-a21a-4e67-b693-4d4101e757c7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.757368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.758026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.758259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.758532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.759268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=dbf5da46264042c49bfb291ea9edf81a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:31.760428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.761977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.767948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 222/444] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=dbf5da46264042c49bfb291ea9edf81a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.835545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a4b4-96ae-4188-a015-8999f1f850bf None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:31.873089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:31.873711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:31.873984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:31.874251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:31.874915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:31.875214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:31.876623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:31.886139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 223/445] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:31.892097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:31.936801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:31.987653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.003501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee996-28c9-4b5c-b1c1-dbeb95e015bd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.040918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.041569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.041849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.042123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.048398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.111348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2f3e0-6551-4bcb-8f92-38cccee3d566 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.118370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.119860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.156878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.157536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.157811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.158081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.166327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.170831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:32.176049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:32.177152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:36:32.177976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:32.178845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 224/446] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:32.184318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.255824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 223/447] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:36:32.261916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.310913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c154e-0f10-4d51-a7d4-b2391881d43f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.321060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.346355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.346969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.347243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.347515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.348180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:32.348480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.349874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.357931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 225/448] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:32.363534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.366170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365717-4da6-44c0-8cc8-d163e1001e36 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.398979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.399601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.399871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.400134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] PATH_INFO: `/v3/projects/4d58411542354cf29d4588108234a14a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.401265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] RBAC: Authorizing `identity:get_project(project_id=4d58411542354cf29d4588108234a14a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.402697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.404347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 224/449] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/projects/4d58411542354cf29d4588108234a14a => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:32.409836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.418175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.462598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967aaa5-813c-43f5-a51a-235de1767135 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.498928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.499563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.499840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.500109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.512936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9898-7ef1-45ad-b63e-5f8aa5bdda8a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.540507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.545640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.546267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.546549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.546814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] PATH_INFO: `/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.547895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] RBAC: Authorizing `identity:get_group(group_id=0d80bc84b38f4ae0a3d01ceeceea3b55)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.549415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.550966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 225/450] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/groups/0d80bc84b38f4ae0a3d01ceeceea3b55 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:32.556939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.568279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.570198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.630393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.655452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf1b0-ec85-4763-95a2-942d25c80b9e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.671096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 226/451] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:36:32.676741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.688210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.688813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.689121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.689390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.690111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] RBAC: Adding query filter params (group.id=0d80bc84b38f4ae0a3d01ceeceea3b55, role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=4d58411542354cf29d4588108234a14a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:32.690411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.691828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.697488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 226/452] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/role_assignments?group.id=0d80bc84b38f4ae0a3d01ceeceea3b55&scope.project.id=4d58411542354cf29d4588108234a14a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:32.748908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:32.780600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd1d0c-a401-47b1-adcf-eb5fa99717c7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.817809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.818441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.818714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.819099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] PATH_INFO: `/v3/projects/3b3b177b7bdd47fbbe8d53653a263794` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.820363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] RBAC: Authorizing `identity:get_project(project_id=3b3b177b7bdd47fbbe8d53653a263794)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.821866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.823521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 227/453] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/projects/3b3b177b7bdd47fbbe8d53653a263794 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:32.829481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:32.935346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebab68-d23e-49b4-a922-5ed8514afe21 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:32.969661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:32.970291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:32.970570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:32.970839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] PATH_INFO: `/v3/groups/45ad1110b2e84e2abe3952aa00ee2432` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:32.971963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] RBAC: Authorizing `identity:get_group(group_id=45ad1110b2e84e2abe3952aa00ee2432)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:32.973507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c038-9e97-48a6-aa13-8e7a6a7b8226 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:32.975322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 227/454] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/groups/45ad1110b2e84e2abe3952aa00ee2432 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:32.981282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:33.078480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db906-9a9e-4660-81fa-851680801b3b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:33.114063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:33.114649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:33.114920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:33.115184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:33.115968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] RBAC: Adding query filter params (group.id=45ad1110b2e84e2abe3952aa00ee2432, role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3b3b177b7bdd47fbbe8d53653a263794) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:33.116247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:33.117743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a539f8-2f02-4ab2-8872-4e126eb84e96 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:33.123476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 228/455] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 11:36:32 2022] GET /identity/v3/role_assignments?group.id=45ad1110b2e84e2abe3952aa00ee2432&scope.project.id=3b3b177b7bdd47fbbe8d53653a263794&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:35.422372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ec59-f0af-471b-a597-2543d2c9a9d1 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:35.422882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ec59-f0af-471b-a597-2543d2c9a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:35.422882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ec59-f0af-471b-a597-2543d2c9a9d1 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:35.424497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 228/456] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:35.430105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c291-eea0-4f52-86e7-e6fc176f0b5d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:35.430964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c291-eea0-4f52-86e7-e6fc176f0b5d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:35.431435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c291-eea0-4f52-86e7-e6fc176f0b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:35.441748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:35.457762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c709c291-eea0-4f52-86e7-e6fc176f0b5d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:35.458975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c709c291-eea0-4f52-86e7-e6fc176f0b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:35.547598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 229/457] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:35.644816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1009cb-bf65-4b4f-a6b8-5b1941dac8e2 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:35.645494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1009cb-bf65-4b4f-a6b8-5b1941dac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:35.645963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1009cb-bf65-4b4f-a6b8-5b1941dac8e2 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:35.647833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 229/458] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:35.653370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:35.653887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:35.654372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:35.673413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:35.674880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:35.743012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 230/459] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:35.870286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1009cb-bf65-4b4f-a6b8-5b1941dac8e2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:35.880858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:35.995257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1009cb-bf65-4b4f-a6b8-5b1941dac8e2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.038050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.039062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.039527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.040009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.054284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.055986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:36.075209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:36.076170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:36.077022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:36.077022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.077022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:36.078800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 230/460] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:36.085240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.113631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.174889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:36.182180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:36.230901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd3b3d-6b8f-4d05-b754-21db43690aec None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.233004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff4a1d-e78c-4209-9d27-12d144b7b63b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.274202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.275001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.275400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.275761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.280430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.281239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.281682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.282096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.282882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:36.283326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.285424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e040be-cd9e-4eb8-8f3e-d3ff2d909166 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.288469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.290005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.299608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 231/461] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:36.300959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f490e6-77b4-447d-9d2f-ef47855fd54b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.300959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f490e6-77b4-447d-9d2f-ef47855fd54b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.301307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f490e6-77b4-447d-9d2f-ef47855fd54b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.302656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 232/462] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:36.303730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ed60-edb7-49d4-9460-e26f949ec426 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bf7d92d1-ce50-4d15-9690-bbc6a0d7633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:36.304051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:36.304901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:36.306290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:36.306290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.306290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:36.306527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ed60-edb7-49d4-9460-e26f949ec426 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.306527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ed60-edb7-49d4-9460-e26f949ec426 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.306719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 231/463] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:36.306801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 233/464] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:36.310569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ed60-edb7-49d4-9460-e26f949ec426 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.311051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8af-2ede-4a5e-afc8-7671dd5119b8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.312504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8af-2ede-4a5e-afc8-7671dd5119b8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.312504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb8af-2ede-4a5e-afc8-7671dd5119b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.329763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4d9eb8af-2ede-4a5e-afc8-7671dd5119b8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:36.331276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4d9eb8af-2ede-4a5e-afc8-7671dd5119b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:36.398091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 232/465] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:36.399139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.399425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.399697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.419868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:36.421781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:36.423253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ed60-edb7-49d4-9460-e26f949ec426 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.448296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:36.467393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.468412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.468877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.469234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.469878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:36.470182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.471555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.471670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:36.497174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 234/466] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:36.498399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.521027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 233/467] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:36.521027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.660237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263a82-a3b6-454a-bb7e-f6a9fdb99940 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.689951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba081f2-e2f2-40ca-9aa4-146939082ac4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.703512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.704125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.704399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.704666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.705644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.707195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.733414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 234/468] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:36 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:36.733869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.734242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.734971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.735445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.735958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.736986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.738911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.767315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 235/469] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:36 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:36.771513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:36.855084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5d98-0d2d-407c-b889-b8c928ba0c20 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:36.894114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:36.894769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:36.895043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:36.895309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:36.908712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:36.909566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:36.921014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:36.928073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:36.929258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:36.930144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:36.930144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:36.930144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:36.930144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 235/470] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:36.935669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:36.981366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:37.040569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:37.064148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3dc8e-44f3-4c28-b4e9-d03cd2f86ea3 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.070215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a2882-9a9f-423e-95ed-bcb016f3c834 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.113937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.114891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.115073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.115467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.115801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.116078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.116193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.116402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.117270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:37.117583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.119293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.128328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.130006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.139080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 236/471] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:37.140398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-6b851a76-880e-40f6-b37f-cc26e4641ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:37.154823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:37.155959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:37.156999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:37.156999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:37.156999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:37.158672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 236/472] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:37.159979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d960a-2217-41c8-8434-1830b87b6223 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.160255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d960a-2217-41c8-8434-1830b87b6223 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.160526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d960a-2217-41c8-8434-1830b87b6223 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.162064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 237/473] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:37.165879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d960a-2217-41c8-8434-1830b87b6223 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:37.259335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9e00-91fa-4941-84b4-0830de1afdc7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.294721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:37.295401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.296085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.296545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.296887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.297846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.300111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaeeaa-f15c-4a64-8351-5736d33619ce None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.306525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d960a-2217-41c8-8434-1830b87b6223 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.311430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:37.327080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 237/474] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:37 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:37.328581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.328980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.329384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.349896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.350985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.351204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:37.351641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.352127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.352666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:37.353189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:37.353713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.355562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.371378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 238/475] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:37.379025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:37.427188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 238/476] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:37.581934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999322ef-3668-48b7-ae86-a8c13272c96f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.622117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.622731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.623013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.623290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.623931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.625469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.650089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 239/477] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:37 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:37.733608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:37.842980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86782d4a-e602-4c0f-bb08-c8b2ae32e65f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:37.870103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:37.883208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:37.883823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:37.884103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:37.884373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:37.885104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:37.886506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:37.896318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.sql.core [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:36:37.896318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 11:36:37.896318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [parameters: {'id': '556fcf6026d1427c9dfe7c23f1ea8d88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 11:36:37.896318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:36:37.914832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:36:37.915829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application yield resource Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise self.value Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application session.commit() Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:36:37.916703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:36:37.917591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:36:37.918641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:36:37.919468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [parameters: {'id': '556fcf6026d1427c9dfe7c23f1ea8d88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:37.921378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 11:36:37.923314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:37.925224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 239/478] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 11:36:37 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:37.925355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:37.942917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:38.051595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b85a1-3669-4542-b772-45ed518efb17 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:38.099136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:38.100196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:38.100662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:38.101148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:38.119753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-8a1a7988-58cd-45ec-bba6-ff2895fd7e0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:38.125601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:38.126548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:36:38.127344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:38.129647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:38.135616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:38.273049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a62bf-a3e1-4a35-8ede-bc73f975476f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:38.309180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:38.310200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:38.310670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:38.311142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:38.312018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:38.312529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:38.314162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843965-7134-47cf-998a-b4a0c7b0bf26 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:38.323842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:38.971913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78f22f-0e01-40f1-a81b-645f2bdd963c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:38.972426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78f22f-0e01-40f1-a81b-645f2bdd963c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:38.972532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78f22f-0e01-40f1-a81b-645f2bdd963c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:38.974086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 241/481] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:38.979779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd795-938b-462f-bc9b-983dcb313371 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:38.980206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd795-938b-462f-bc9b-983dcb313371 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:38.980386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd795-938b-462f-bc9b-983dcb313371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:38.999352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9bebd795-938b-462f-bc9b-983dcb313371 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:39.000572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9bebd795-938b-462f-bc9b-983dcb313371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:39.061378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:39.090310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 241/482] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:39.176931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4061d6-ada9-4893-a423-c9fd653ee614 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:39.177269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4061d6-ada9-4893-a423-c9fd653ee614 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:39.177514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4061d6-ada9-4893-a423-c9fd653ee614 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:39.179297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 242/483] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:39.184144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:39.184434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:39.184706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:39.214302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:39.215541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:39.284120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 242/484] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:39.535590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4061d6-ada9-4893-a423-c9fd653ee614 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:39.609426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:39.650675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4061d6-ada9-4893-a423-c9fd653ee614 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:39.660493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:39.690283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:39.690915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:39.691194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:39.691464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:39.717642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:39.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:39.726238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:39.727018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 243/485] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:39.731585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:39.854388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfd4d3-299b-4cb5-9fd8-b6868e8dd0c6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:39.873702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8eb3e-eef1-4a82-beb7-a7305184ba2a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:39.874736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:39.902076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:39.917380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:39.918296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:39.919465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:39.920293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:39.921197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:39.922702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:39.926191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:39.927061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:39.929615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:39.930168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:39.930746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:39.946361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 244/486] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:39.952167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:39.956196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:39.961924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:39.962831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:39.963637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:39.972801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 243/487] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:39.979695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.080549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d46ef-5752-4feb-8e70-4f428fe4824c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.093365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820517-a921-4847-b0a1-a13b8f15e8f2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.116807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.117832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.118310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.118780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.131375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.131955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.132063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.132299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.132640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.133351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:40.133651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.134615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.135033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2f9b-01b1-454a-a446-f9f00f788710 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.144348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 244/488] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:40.145682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cb76-ca4b-4fee-abc2-a2295132638b None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.145968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cb76-ca4b-4fee-abc2-a2295132638b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.146243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cb76-ca4b-4fee-abc2-a2295132638b None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.148023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 245/489] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:40.149922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cb76-ca4b-4fee-abc2-a2295132638b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a9ae17a2-8e8c-4844-a2bf-56f0ba1c8040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:40.152032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:40.153104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:40.153945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:40.153945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:40.153945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:40.154640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 245/490] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:40.155803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530313f-1e81-46c3-b13b-83e2a702e3b5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.156088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530313f-1e81-46c3-b13b-83e2a702e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.156359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530313f-1e81-46c3-b13b-83e2a702e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.180200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c530313f-1e81-46c3-b13b-83e2a702e3b5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:40.182125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c530313f-1e81-46c3-b13b-83e2a702e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:40.183983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.226103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.255555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cb76-ca4b-4fee-abc2-a2295132638b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.264828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 246/491] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:40.267206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0cd2-e536-4836-8bec-bb9e154de826 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.267496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0cd2-e536-4836-8bec-bb9e154de826 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.267767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0cd2-e536-4836-8bec-bb9e154de826 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.273412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 247/492] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:40.273412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db0cd2-e536-4836-8bec-bb9e154de826 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.302636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.303353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.303640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.303907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.315311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.316835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-9a4f8d22-beb7-4c9b-8df7-05b04c6e79bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:40.331914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:40.332827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:40.333693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:40.333693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:40.333693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:40.338024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 246/493] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:40.339239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.339519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.340147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.358246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:40.359434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:40.394232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db0cd2-e536-4836-8bec-bb9e154de826 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.433004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 247/494] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:40.433004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.439042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.439960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.440462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.440939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.441819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:40.442309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.444287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.445185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.468961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 248/495] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:40.474245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.534552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb368ec-3a8c-4987-b40d-0b7339eb64ec None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.562718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.570158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.570965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.571242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.571506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.572144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:40.572441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.573846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.587134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 248/496] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:40.592352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.654273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1772f7-27d8-4c9a-a3d0-4480298ccb0d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.671577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.697913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc216c-9ba1-419d-91c1-349766c4f982 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.701545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.702197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.702468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.702732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] PATH_INFO: `/v3/users/glance` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.715081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.717094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.734823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:40.735035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:40.735884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:40.736773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:40.737308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.737308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.737308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.737482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 249/497] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:40.738080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.752459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:40.758157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:40.759040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:40.759823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 249/498] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:40.760472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.848526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.859554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3924-c8e0-4339-9ab7-d3d736a5ffdc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.869727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb297f2-3a3d-4762-bd2b-034cc916247a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:40.899889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.900542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.900817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.901151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.907504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:40.908356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:40.908636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:40.908816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.908931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:40.909682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:40.909989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:40.910566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.911423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:40.914504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:40.922516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:40.923622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:40.924715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:40.925846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 250/499] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:40.929811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:40.959043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 250/500] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:40.960256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.039564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a71bbf-d092-4640-848d-c483025bcc4f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.060718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d695-aca8-4b9a-b099-b1e771dec461 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.072676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.073305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.073586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.073850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.074510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:41.074804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.076176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.084246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 251/501] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:41.085343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.098228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.098856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.099135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.099404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.100067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.109982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:41.114820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:41.115991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 251/502] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:41.116933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.169831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.183993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b864f80-9197-4552-a633-4a80c4f7d74f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.217675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247b0c-1dee-4b3b-ac57-0960f048f945 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.219662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f44c3-0345-426b-a303-c4293895786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.220522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f44c3-0345-426b-a303-c4293895786d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.220522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f44c3-0345-426b-a303-c4293895786d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.220801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f44c3-0345-426b-a303-c4293895786d None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.221559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f44c3-0345-426b-a303-c4293895786d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:41.221869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f44c3-0345-426b-a303-c4293895786d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.223324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f44c3-0345-426b-a303-c4293895786d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.251153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.251750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.252024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.252288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.260842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 252/503] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:41.262244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a183-6805-48c0-8dba-9bf64e785601 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.262644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a183-6805-48c0-8dba-9bf64e785601 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.263178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4a183-6805-48c0-8dba-9bf64e785601 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.264609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 253/504] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:41.265479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a183-6805-48c0-8dba-9bf64e785601 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.326422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.327972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.353331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.377951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.382860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4a183-6805-48c0-8dba-9bf64e785601 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.417315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.417947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.418225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.418503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.425093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 252/505] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:41.425614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.432681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.434194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:41.448905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:41.450099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:41.451330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:41.451330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:41.451330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:41.453336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 254/506] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:41.453983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.530464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716eb84-b711-4b3f-bd60-75cc250f073a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.557540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e766ac-921c-4b34-beaa-c0e32137be3a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.563588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.564200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.564512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.564787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.565479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:41.565784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.567169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55d9c-cc11-4a1c-ad6a-b7ff315c0090 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.574898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 253/507] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:41.576046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.576331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.576604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.583452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.594945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.595570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.595850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.596125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.596231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:41.597379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:41.607238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.665792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 254/508] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:41.666432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.666609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.668014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.771089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb18d9-b3ee-4a87-a69a-985ac2f41a5d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.771483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 255/509] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:41.772325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.797656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.815905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.816622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.816900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.817238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.827624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.829325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.832716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:41.846577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:41.847693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:41.848770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:41.848770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:41.848770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:41.852885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 255/510] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:41.853617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.881726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae4d20-4f0c-48d2-a6fa-29c7eb3c11d7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.918156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.918838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.919114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.919381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:41.920044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:41.920340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:41.921740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:41.938718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 256/511] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:41.938718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:41.960485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399b86-2371-47d1-bbd8-7938bca4407e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:41.993536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:41.994161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:41.994442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:41.994709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.005105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.006723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.020020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:42.020802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.022057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:42.022996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:42.022996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.022996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:42.022996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 256/512] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.023206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.037847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b234b2-1f37-459e-a42e-15930ff1cc4d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.071601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.072227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.072495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.072774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.072915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.083427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.084936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:42.099066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.100024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:42.100851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:42.100851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.100851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:42.100851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 257/513] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.101101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.128369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8bb41-53d6-46cd-a5b0-e700892684a7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.161319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.162036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.162314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.162632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.163347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.163650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.165084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.176632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 257/514] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.177455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.199939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f68da-d04c-41a6-84b4-fd771c3857b1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.234242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.234873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.235145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.235409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.238190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.246638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.248086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:42.261840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.262747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:42.263597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:42.263597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:42.263597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:42.263597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 258/515] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.264930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.280217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db61c-f0da-4b75-b114-79d79f826090 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.291477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.317847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.318477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.318791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.319115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.326518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.327965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:42.341412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.342324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:42.343190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 258/516] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.344297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.369842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f54a1-10db-498d-80c0-15abf996dc55 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.403166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.403773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.404045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.404317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.404952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.405276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.406637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.418958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 259/517] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.419612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.445259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3c85-b299-47bd-a64b-3e8082c70117 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.467894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.478893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.479497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.479770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.480036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.480671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.480973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.482374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.498867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 259/518] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.503500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.518952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36783-7060-413c-b751-3bb772901f52 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.529628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.554459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.555089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.555362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.555628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.562281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.563743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:42.575601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.576480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:42.577353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 260/519] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.577802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.601267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b34c3-3e2e-464b-9835-394beccbdd72 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.635748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.636358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.636640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.636911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.637585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.637887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.639267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.654874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 260/520] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.654874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.683910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be49f-bfa6-4ade-900b-ee4cf9859839 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.692445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.717308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.717920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.718196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.718464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.719187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.719488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.720935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.737503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 261/521] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.739674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.742109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.753034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6626-5610-4d58-94f4-f8cd724830df None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.785471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.786099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.786379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.786655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.794149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.795601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:42.807253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.808362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 261/522] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.809488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.843393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe4bb-f550-4867-8c89-7f09014ffbb2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.879067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.879691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.879967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.880229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.886904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.888373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:42.899782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:42.900691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 262/523] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:42.906718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.909001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153bd9-0768-45dc-8779-236f02de9a42 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:42.931557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:42.943958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:42.944571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:42.944851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:42.945185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:42.945887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:42.946189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:42.947640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:42.966487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 262/524] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:42.967295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:42.977549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.008453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9dd5-fd84-4e8e-ae02-ba40e2b9369d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.040979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.041612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.041890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.042164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.042827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.044269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.065412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 263/525] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:42 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:43.065990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1c02-e376-47d2-a0bd-a69dd34b921b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.066281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.109167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.109908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.110190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.110459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.163439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.185006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.186642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37838-50db-4d80-8df7-c435513fd77e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.187264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.198206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.226805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.227416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.227689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.228007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.228720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:43.229044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.230487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.248536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 264/526] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:43.249572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.301826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 263/527] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:43.302486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.359537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa3fc7-3145-4365-add2-b8882ef1becc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.395588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.396090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.396363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.396620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.397373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:43.397671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.399107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.406764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4edb57-25a9-404d-a6e2-10c4c8858132 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.414052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.417868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.422214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 265/528] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:43.423107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.445755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.446367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.446791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.447062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.447845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=bab5524ecd44403bb82fd4d6433fb002) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:43.448085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.449596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.455579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 264/529] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/role_assignments?user.id=bab5524ecd44403bb82fd4d6433fb002&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:43.456257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.572789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec34ff-244d-41f5-8f42-ad9af8bbb504 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.583989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ead6-c00e-4776-9188-7893a7198d55 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.621895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.622751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.623644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.623644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.629103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.629908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.630321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.631011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.636135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.638946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:43.665042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:43.666029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:43.666885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:43.666885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:43.666885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:43.666885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 265/530] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:43.667779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.708510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.724422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:43.729910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.732100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.803131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c6247-3e0c-4f91-9499-d6585ee2b43d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:43.839312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:43.839924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:43.840196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:43.840467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:43.841268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:43.841570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:43.843002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:43.848601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 266/531] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:43.849234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:43.867939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 266/532] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:43.873610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.033435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7ccd-6bf0-4d9d-9ab0-45b1dcf34713 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.049387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.050154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.054227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b477-d890-4359-93e3-18ead2236c87 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.085421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.087143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.090177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.090624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.091445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:44.091914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.093481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.115479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 267/533] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:44.121186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.126557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.127410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.127854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.128305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.148318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.151376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:44.179227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:44.180593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:44.181451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:44.181451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:44.181451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:44.194381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 267/534] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:44.196192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.270816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfde3b-0d15-46c0-b286-7a461c12aa30 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.310592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.311230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.311511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.311782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.323642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.325141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:44.347563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:44.348469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:44.349335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:44.356014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 268/535] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:44.357155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.371929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434ccb-1758-46a7-8db8-5fb112804417 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.376285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.407829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.408543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.408826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.409133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.409775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:44.410078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.411469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.425759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 268/536] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:44.430997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.445919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.536906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fe3a6-62ae-47e0-88e7-34e3c3d37390 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.572247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.572881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.573181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.573493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.580842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.582307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:44.593894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:44.594775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:44.595698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:44.599390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 269/537] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:44.601083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.614059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ae37f-feab-4b27-979f-efca17e0628d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.670934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.687783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.688510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.688792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.689091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.689798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:44.690100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.691633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.703161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a7c68-4eb2-44c7-a728-a51e09661abb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.717897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 269/538] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:44.724151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.769276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.769893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.770175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.770447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.771150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:44.771458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.773282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.799036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 270/539] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:44.805037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:44.843116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:44.911587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725582a-49a8-4b23-8574-b703aef29522 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.960605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454ce2c-1146-44fd-aead-212da7671494 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:44.985701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:44.986328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:44.986635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:44.986867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:44.987601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=aea417bef9414609b3c79bbf2cc2ced2) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:44.987900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:44.989346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b171f-9712-4667-84a6-6aedb6ed5134 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:44.999940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 270/540] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/role_assignments?user.id=aea417bef9414609b3c79bbf2cc2ced2&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:45.001596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:45.002553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.003036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.003474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.004451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=c1015e2218b14b85aba318460f6deb85) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:45.004912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:45.006781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593076b-36ca-43fe-822d-da57a7468a58 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:45.010618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:45.015073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 271/541] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:44 2022] GET /identity/v3/role_assignments?user.id=c1015e2218b14b85aba318460f6deb85&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:45.216728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb815-2891-4c53-b664-761b9123553d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.217056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb815-2891-4c53-b664-761b9123553d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.217242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb815-2891-4c53-b664-761b9123553d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.218869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 271/542] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:45.224592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6db5-d4ac-4760-b3fd-49212d95ef06 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.225769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6db5-d4ac-4760-b3fd-49212d95ef06 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.226324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6db5-d4ac-4760-b3fd-49212d95ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.253085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9fcb6db5-d4ac-4760-b3fd-49212d95ef06 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:45.254663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9fcb6db5-d4ac-4760-b3fd-49212d95ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:45.339660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 272/543] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:45.584640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2c13-f670-4cb9-8266-c967d7179d6b None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.585377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2c13-f670-4cb9-8266-c967d7179d6b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.585377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2c13-f670-4cb9-8266-c967d7179d6b None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.586968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 272/544] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:45.592328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.592618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.592895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.617983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:45.619166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:45.697322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 273/545] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:45.717254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d2c13-f670-4cb9-8266-c967d7179d6b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:45.860736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d2c13-f670-4cb9-8266-c967d7179d6b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:45.895365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:45.900777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:45.901909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:45.902567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:45.903083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:45.918766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:45.924102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:45.924960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:45.925783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 273/546] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:45.931970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:45.999396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.025383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.105062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587180-e6e8-40ec-9845-68df8e8fca39 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.166836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.168403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.168885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.169576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.170629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:46.171076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.173300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1250-08dc-44b1-b1c0-79e35f36ab37 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.178071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81904f-7efc-4784-873c-f2643c17805b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.187840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 274/547] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:46.189748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d0804-10af-4ffe-a208-164011480471 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.190176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d0804-10af-4ffe-a208-164011480471 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.190586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d0804-10af-4ffe-a208-164011480471 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 275/548] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:46.197791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d0804-10af-4ffe-a208-164011480471 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.220253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.221131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.221508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.221876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.236190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-1bca9468-3edf-4510-81ab-25da766defe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:46.242688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:46.243604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:46.244399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 274/549] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:46.250201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.250201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.250201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.269041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:46.270660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:46.309486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d0804-10af-4ffe-a208-164011480471 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.334730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.336288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.355668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 275/550] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:46.357014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.406490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.407093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.407372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.407642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.434343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.436339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.467879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2585-b342-420f-b1e2-57133b13b7d6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:46.473638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:46.474869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:46.475883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:46.475883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:46.475883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:46.475883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 276/551] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:46.480689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.514826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.515804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.516278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.516778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.517693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:46.518619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.520210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.529635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 276/552] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:46.536835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.619815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.683275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d8701-1223-4331-9977-d8d9405d6f63 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.693753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa1a7-e49b-462e-a592-4b33313db1c2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.720172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.720750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.721024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.721301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.721940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:46.722239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.723847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.731959 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.732892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.733393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.733929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.737858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 277/553] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:46.738688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.747622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.749512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:46.765093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:46.766167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:46.767065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:46.767065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:46.767065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:46.769364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 277/554] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:46.770462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.776764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.851668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e20b91-cbc6-4186-8aeb-645912483616 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.873681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:46.880110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276759-23ae-499d-b56b-05a974830ae0 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:46.892164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.892619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.892897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.893199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.904800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:46.909942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:46.910890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:46.911775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:46.916276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 278/555] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:46.917266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:46.922294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:46.923198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:46.923711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:46.924189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:46.932917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:46.934986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:46.947945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:46.948915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:46.950374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:46.952994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 278/556] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:46.954081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.018340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.028873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd624-d970-4a8c-8ddc-6a3f5704e423 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.064541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3b280-7ce7-46b8-9485-c88a37205515 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.066723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.067347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.067626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.067914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.068984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:47.069114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.070431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.087918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 279/557] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:47.088590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.103111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.104068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.104621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.105239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.106125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:47.106667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.108482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.117893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 279/558] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:47.119030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.139426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.201579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b7b7c-fd43-4af7-bf7b-db44f7482fbb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.223738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da640fd-6f2a-4852-8f8b-46d632e41590 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.237078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.237696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.237976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.238249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.239079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:47.239386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.241239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.264751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 280/559] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:47.264751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.266015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.266977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.267454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.267915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.276905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.278719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.285405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:47.291015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:47.291978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:47.292898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:47.299633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 280/560] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:47.299633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.367394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599c411-690d-46c7-ae58-d340b8811279 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.382578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.402605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.403236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.403519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.403795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.403983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856facff-49e0-432c-b0ac-a4dc7e309cd9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.414120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.415571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-8be5860c-c0d8-428f-bf05-3d91c528a00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:47.430161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:47.431120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:47.432028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:47.432028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:47.432028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:47.432028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 281/561] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:47.432399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771351-79b9-407d-ad97-ad40afa8c760 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.432818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771351-79b9-407d-ad97-ad40afa8c760 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.432917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771351-79b9-407d-ad97-ad40afa8c760 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.434217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 282/562] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:47.434898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771351-79b9-407d-ad97-ad40afa8c760 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.442974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.443619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.443899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.444169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.499124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.512673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.514176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83131974-d6ea-4d02-bc86-1ff290e00191 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.542529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771351-79b9-407d-ad97-ad40afa8c760 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.574428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.575028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.575300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.575597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.576311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:47.576613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.578078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89fa4-26cb-44f5-bb65-5d114c7b8f5c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.590729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.595952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 283/563] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:47.597328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f92d43-d2f0-4fdd-8328-54f528b9a774 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.597751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f92d43-d2f0-4fdd-8328-54f528b9a774 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.598166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f92d43-d2f0-4fdd-8328-54f528b9a774 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.599615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 284/564] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:47.600601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f92d43-d2f0-4fdd-8328-54f528b9a774 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.616609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 281/565] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:47.617889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.618201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.618716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.635950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:47.637165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:47.702993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 282/566] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:47.703313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f92d43-d2f0-4fdd-8328-54f528b9a774 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.703819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.724536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.742727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.743270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.743549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.743823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.744708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:47.744823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.746161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a6bb-8a82-4cde-a3f2-4b036a015a29 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.758392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 285/567] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:47.762845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.763110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.763415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.781754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:47.782955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:47.811850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d72c-10df-4e98-a033-9ef4b4d89be0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.823829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:47.850098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:47.850874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:47.851153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:47.851419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:47.861051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 286/568] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:47.861051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.870372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:47.872058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:47.888775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:47.889970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:47.891046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:47.891046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:47.891046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:47.896076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 283/569] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:47.897344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:47.978439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a00b-e138-4b43-8660-75621b050c65 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:47.988414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.005583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e6ca-51b2-4576-853d-48c43533fbfa None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.015575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.016520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.016809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.017119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.027985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.029502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.040389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.041157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.041437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.041705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:48.044275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.045290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:48.046185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:48.046185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:48.046185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:48.046185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 287/570] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.046185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.051667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.053819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:48.069545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.071063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:48.072022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 284/571] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:36:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.073027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.137509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.176909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea65ea4-1f5d-41ed-a3b3-2ebff5dc46e1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.212497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.213238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.213591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.213835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a24907-6f6a-4087-b08c-7a4625abc246 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.214017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.214757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:48.215161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.216620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.228740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 288/572] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:48.229698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.249365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.249995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.250268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.250532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.255792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.260706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:48.266548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.267618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 285/573] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.270111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.338700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f38f2-8ce1-46ef-9fa0-1e797e17b51f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.357232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.373819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.374435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.374718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.374989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.375834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:48.376446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.377915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.381653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b7c3-9f99-4abb-826a-d6e8291c9b30 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.390456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 289/574] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:48.391284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.416338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.416947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.417257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.417534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.418257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:48.418559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.419982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.441618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 286/575] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:48.441618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.478299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.497951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe8a6-334e-49ad-a525-cc446debbf5f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.531898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.532457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.532732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.533032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.537098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4159128-0b79-4d2b-ad19-7ee113ea021c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.542996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:48.548118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.549261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 290/576] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.550286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.574855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.575486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.575762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.576028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.582963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.584452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.586223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:48.596569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.597691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 287/577] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.598593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.651669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d98f-a210-45b9-ab61-b68962fb857f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.683774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.684374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.684648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.684915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.685601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:48.685901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.687537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.695525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 291/578] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:48.696294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.697120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c138-4a05-44b4-8cd9-801064bb12f1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.698764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.732976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.733609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.733890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.734158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.740749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.742258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:48.753243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.754197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 288/579] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.755087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.798040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5a35-003d-48de-bb1d-919a8e0a5c65 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.815602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.832714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.833357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.833634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.833901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.844361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.845826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.857531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509325-0f27-425b-a2db-0fb1e9277e70 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:48.860059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:48.861179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:48.862212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:48.862212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:48.862212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:48.862212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 292/580] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:48.862443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.891666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:48.892453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:48.892762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:48.893037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:48.893699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:48.894000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:48.895519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:48.903357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 289/581] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:48.904141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:48.920250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:48.966409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79002f-1cf8-4eab-b5a4-a9211e623f2f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.000776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.001491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.001685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.001952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.002644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.002949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.004377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.004958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6244-cf1d-45e0-86c5-341b1af06b84 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.017001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 293/582] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.017794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.029797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.043976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.044603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.044880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.045188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.055553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.056934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:49.072258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:49.073297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:49.074227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:49.074227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:49.074227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:49.074227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 290/583] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:49.074472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.120384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f42e1-a901-42f3-8a49-d179c7c1cc70 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.134683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.154713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.155318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.155600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.155882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.156571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.156877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.158368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.170373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 294/584] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.170970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.178950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da14ee-c9cd-466b-93fe-af0016c2d2a8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.214375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.215036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.215315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.215602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.216243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.216546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.217937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.229907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 291/585] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.231015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.260295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.273086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44636ff5-a8c0-4e61-8d8f-954bc0d24295 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.305470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.306137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.306364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.306631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.316906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.318384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.329800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ce66e-984e-42f6-8862-9c2299f72a6e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:49.333212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:49.334207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:49.335137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:49.335137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:49.335137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:49.335137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 295/586] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:49.335137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.362435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.367427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.368089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.368366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.368634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/bab5524ecd44403bb82fd4d6433fb002/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.382941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=bab5524ecd44403bb82fd4d6433fb002, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.384384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.397293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 292/587] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:49 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/bab5524ecd44403bb82fd4d6433fb002/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:49.398076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.455559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac34f-3cc6-43aa-b985-f9276916c678 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.493597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.494364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.494702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.495110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.495853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.496279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.497917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.498756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.513680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 296/588] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.514725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.526653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfab64b-4209-4fd8-ab51-9d6563e509ce None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.566915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.567454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.567733 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.568001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.569375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=6e6a60e442924d9e92910b778414a60e) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.569702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.571159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.577392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 293/589] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/role_assignments?user.id=6e6a60e442924d9e92910b778414a60e&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.578068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.619814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.652212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032984c3-b4f8-41cb-af03-51d086c01464 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.699434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.700789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.701125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.701531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.711642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.711834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68000fbf-8099-407b-94f0-e526be199744 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.713153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:49.729700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:49.730633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:49.731512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:49.735888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 297/590] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:49.737304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.767043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.768008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.768493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.769038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.769876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.770420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.772219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.786972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 294/591] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.788214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.799438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.857983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5da7f-fe52-4474-bf58-a0c2902ddadc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.893050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.894166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.894615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.895068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.902826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.904475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.908706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c95a-2737-415e-9979-80a11d0a41d7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:49.917218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:49.918385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:49.919569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:49.921826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 298/592] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:49.922879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:49.934428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:49.949168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:49.950232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:49.950725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:49.951182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:49.952130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:49.952711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:49.954479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:49.967805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 295/593] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:49.969110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.031441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b81fca-b63c-4b68-9a5b-ff0ab0b8d72d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.039277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.070175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.070925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.071207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.071478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.077323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d48c1-d7b8-499b-abf8-6734640a6aa8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.079632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.081608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:50.093832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:50.094833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:50.095743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 299/594] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:50.096346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.116874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.117904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.118373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.118847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.119823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:50.120362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.122063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.140992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 296/595] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 11:36:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:50.142223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.166123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.203651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b061a4-e86f-4358-8873-dc434dd9d5b4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.239375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.240040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.240366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.240645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.252268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a5-503c-45da-a6df-8c3cdfa2bd0f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.256556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=51f86708703f4f86953e188c3bac4c58, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.258045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.272891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 300/596] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:50 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:50.274007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.279236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.292031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.293208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.293678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.294242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.295160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:50.295722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.297607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.318453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 297/597] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:50.329000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.392895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dd1b6-0b94-4224-8826-47a2b9289662 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.412229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.433202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.433849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.434132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.434401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.447851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.449542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:50.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:50.469551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:50.470447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:50.470447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:50.470447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:50.470447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 301/598] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:50.475942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.537507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0474f4-2c6d-4668-9348-582652d4d531 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.594935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca7ab-2017-4a53-ab41-1a7d00729afd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.601281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.601933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.602213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.603837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.614968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.616622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:50.634994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:50.635988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:50.637677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:50.637677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:50.637677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:50.637677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 298/599] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:50.641575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.641981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.642205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.642489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.642766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.643473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:50.643720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.645400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.662242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 302/600] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:50.667684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.685413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.696507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.755021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fdf0e-b4f1-4998-85ff-787026d0e8ab None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.774678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610649-1683-4a30-b650-0dd4e9f0c26e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.790874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.791575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.791855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.792122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.792862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:50.793210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.801837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.809952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.810596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.810875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.811146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.818095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.819695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.822890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 299/601] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:50.833955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:50.836540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:50.837457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:50.838713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 303/602] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:50.843392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:50.943286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7882a-8503-4276-8096-5bf1537da567 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.945307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.974536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:50.979865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:50.980483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:50.980761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:50.981066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:50.981170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738192d1-e446-429c-9e68-6d2494828295 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:50.981763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:50.982072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:50.983516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:50.997133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 304/603] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:51.003018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:51.015592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:51.016228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.016506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.016774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.023849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:51.025328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:51.036773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:51.038036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:51.039734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 300/604] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:51.043744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:51.159293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ca37-5265-470e-8377-dbdebbcf3fc8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:51.166205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2320-ec7d-4c33-8dcb-566df0c14464 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:51.223009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:51.223541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.223815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.224085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.225768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:51.226686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:51.228133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:51.238869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:51.239591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.239868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.240137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/c1015e2218b14b85aba318460f6deb85/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.255970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 301/605] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:51.262562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:51.273846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=c1015e2218b14b85aba318460f6deb85, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:51.275328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54b0b-ea81-45de-9dca-49300408c92e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:51.279572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:51.294238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:51.300556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 305/606] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:51 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/c1015e2218b14b85aba318460f6deb85/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:51.375885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5543e-65f7-41b5-8f80-1ee33ba848a7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:51.428587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:51.429501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.429775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.430041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/aea417bef9414609b3c79bbf2cc2ced2/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.453923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=aea417bef9414609b3c79bbf2cc2ced2, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:51.456085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cdea-8ec8-43c0-ac8c-bcad38419862 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:51.483104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 302/607] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:51 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/aea417bef9414609b3c79bbf2cc2ced2/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:51.614515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158c6b-e604-4925-8115-f37366c5135c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.615032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158c6b-e604-4925-8115-f37366c5135c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.615032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158c6b-e604-4925-8115-f37366c5135c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.616943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 306/608] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:51.622925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.623547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.624011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.643615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:51.645189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:51.702576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f81-c475-4d25-8bff-6cd38915f76c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.702927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f81-c475-4d25-8bff-6cd38915f76c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.703125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f81-c475-4d25-8bff-6cd38915f76c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.704662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 307/609] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:51.710188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:51.710742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:51.711227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:51.715931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:51.725208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 303/610] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:51.732877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:51.734287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:51.823197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 308/611] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:36:52.110507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.225007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.225204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea802c3-e0a2-4ddb-b4f3-bb8e588bb8cc None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.290375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.291004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.291275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.291541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.310547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:52.315736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:52.316659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:52.317541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:52.327089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 304/612] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:52.332000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.381196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e48b-5599-4853-82c3-37d19a549556 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.429359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:52.437020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:52.446069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.447054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.448212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.449243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.469808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:52.477550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:52.478640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:52.479678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:52.481927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 309/613] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:52.493149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.534477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed0a6-bdb4-42bb-b778-c3351df294dd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.610290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.610915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.611192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.611463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.612136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:52.612436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:52.613839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:52.623666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 305/614] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:52.634619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.667441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330010d-cb1e-4c00-9a91-7eba443696e7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.711298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.711909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.712278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.712551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.713354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:52.713656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:52.716557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:52.734556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 310/615] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:36:52.740198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.803045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:52.835601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74a6b-8aa2-49ed-a7b0-6226b728fed1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.874354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:52.891537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c7ea1-6ab2-4cb1-a62a-50c85858b5b9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:52.902518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.903211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.903489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.904035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.920367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:52.921851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:52.928402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:52.929360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.929912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.930510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-119f2c8e-d9c7-405b-89d0-415f3ad8bd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:52.938875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:52.939841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:52.940723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:52.940723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:52.940723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:52.940723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 306/616] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:52.944376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:52.945909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b69b-a6cb-4c7e-8c2b-d59449fe2e5d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.946201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b69b-a6cb-4c7e-8c2b-d59449fe2e5d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.946477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b69b-a6cb-4c7e-8c2b-d59449fe2e5d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.946775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:52.948060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 307/617] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:52.948914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b69b-a6cb-4c7e-8c2b-d59449fe2e5d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-57cf7679-573d-48ad-b13c-8ce14950643b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:52.963158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:52.964207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:52.965127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:52.965127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:52.965127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:52.967285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 311/618] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:52.968633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:52.969144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:52.969605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:52.988688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:52.990276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:53.059363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b69b-a6cb-4c7e-8c2b-d59449fe2e5d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.061506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 312/619] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:53.062910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.097386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.101519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.102200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.102480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.102752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.103455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:53.103812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.105286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.133007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 308/620] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:53.139090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.168724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37e32-3209-4106-b5fe-9d3e8e432c43 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.184050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.207290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.208331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.208809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.209360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.210192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:53.210682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.212240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.236767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 313/621] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:53.244074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.328545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab25d6-6aa2-4147-b17b-cad0b17d0640 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.376859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.387797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01693-3654-47c3-afaa-c6768d4b1117 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.413874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.414516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.414791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.415056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.428865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.431922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.432052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.432052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.432052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.432052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.440325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.441886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:53.447683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:53.448617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:36:53.449615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:53.452026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 309/622] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:53.453043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:53.456830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:53.457989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:53.459019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:53.463924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 314/623] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:53.464847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.559333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.573662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5a164-2ee5-45e1-a08f-daef0a8fe905 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.577629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca711f2-c946-494c-919f-7b2231748dbc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.609375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b556-170d-489b-844d-68e756d19766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.610363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b556-170d-489b-844d-68e756d19766 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.610789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b556-170d-489b-844d-68e756d19766 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.611236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b556-170d-489b-844d-68e756d19766 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.613670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.614529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.614688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.615025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.615953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:53.616331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.617869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.623485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405b556-170d-489b-844d-68e756d19766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-c405b556-170d-489b-844d-68e756d19766 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:53.628869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:53.630026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:53.631176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:53.633643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 310/624] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:53.634576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b556-170d-489b-844d-68e756d19766 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.650220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 315/625] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:53.651442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.664684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.742846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b556-170d-489b-844d-68e756d19766 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.756308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03891043-e3ee-4fb8-b192-669bd0a20632 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.776319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.776925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.777234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.777507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.778227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:53.778531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.779964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.790258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.790866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.791148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.791423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.792084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:53.792388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.793796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f64ea-34bf-4b96-9a4a-02eb3fa80af2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.797458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 311/626] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:53.798255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.804716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 316/627] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:53.805936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded764-cf05-4cfc-8c61-937a1b6b2e9b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.806212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded764-cf05-4cfc-8c61-937a1b6b2e9b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.806478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded764-cf05-4cfc-8c61-937a1b6b2e9b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.807800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 317/628] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:53.809901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28052e6-49fb-4b06-b896-3d2b6afbc7b6 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.810025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.810221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28052e6-49fb-4b06-b896-3d2b6afbc7b6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.811206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28052e6-49fb-4b06-b896-3d2b6afbc7b6 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.812717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 318/629] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:53.813966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28052e6-49fb-4b06-b896-3d2b6afbc7b6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:53.884786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:53.902046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9b5d-6316-4b2a-827e-ba8f61294278 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.916167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28052e6-49fb-4b06-b896-3d2b6afbc7b6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:53.938160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.938756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.939028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.939296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.949999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:53.950619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:53.950909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:53.951167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:53.961947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:53.963396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:53.977932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:53.978962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:53.979881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:53.979881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:53.979881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:53.979881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 319/630] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:53.979881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.011008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.012403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10173-824d-42a5-a0e5-fe814ff7bffd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.019762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.075916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038d72-08e2-4224-b130-d1bd6678e77b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.098850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.110100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.110444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 312/631] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:54.110726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.111007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.111279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.111788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.112038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.112310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.122602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.124051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.130412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:54.131623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-739f74cf-2eb2-43fd-9e4b-ecf97e1d9a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:54.138655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.139614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:54.140483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:54.140483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:54.140483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:54.140483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 320/632] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.141069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.141165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.141432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.158987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:54.160201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:54.197673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 313/633] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:54.198512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.228791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 321/634] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:54.229920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.238735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.323246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a191a-0921-43fa-b906-39de4dd40f4a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.352223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2f2f-1e06-4b04-b47a-deece89e6410 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.362292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.368400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.369478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.369925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.370339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.371263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:54.372060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.374064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.391114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 314/635] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:54.392484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.398705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.399425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.399774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.400151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.413685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.415511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:54.435812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.436997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:54.438140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:54.438140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:54.438140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:54.438974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 322/636] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.439879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.510022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.516628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6e4d-1d3a-43f0-a354-5b67ed2251e9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.547086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5eec-9230-4815-9ce4-6371fd5a70d0 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.550105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.550711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.550985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.551254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.551891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:54.552190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.553646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.565424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 315/637] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:54.566198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.590194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.591008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.591312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.591674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.601507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.602967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:54.615187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.616209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:54.617140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 323/638] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.618214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.637421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.684419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4907-9107-433a-bcc6-f52112119488 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.719011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.719465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e480ab-1fbb-4d24-b8d4-63940dc9b5a7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.719606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.719888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.720159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.720802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:54.721136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.722504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.733770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 316/639] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:54.734572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.753945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.754583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.754870 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.755131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.755693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.765373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:54.770564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.771683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:54.772520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 324/640] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.773262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.838668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f460304-5a31-4885-8d11-cc5c0ef30376 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.850751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.872097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46408831-2d00-4a47-a206-78af47c18e2c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:54.872841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.873517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.873801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.874072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.884985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:54.890180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.891198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 317/641] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.892048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.908580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:54.909269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:54.909530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:54.909801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:54.918427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:54.919878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:54.931328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:54.932249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 325/642] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:54.933398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:54.972484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:54.997714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0c9fb-3f4f-4dec-971d-682fb09c196e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.032274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.032804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73534450-8efc-4da0-b31d-48355c551565 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.032932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.033186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.033463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.034139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.034441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.035882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.047637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 318/643] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.048422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.066420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.067047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.067320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.067586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.075201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.076634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.078340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:55.089324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:55.090238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:55.091140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 326/644] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:55.091622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.150741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1264b6-0a1c-49b4-a749-15c29f6c1d70 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.185771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.186379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.186662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.186936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.187605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.187909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.189336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.191442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.192702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6147-1818-4a33-83c4-67a6e2f3183f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.202869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 319/645] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.203609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.228195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.228831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.229141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.229531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.230063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.230356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.231729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.239944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 327/646] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.239944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.298166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.310626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4773-d8ce-40bd-acee-67a1aae88a27 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.339304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d052d-240d-4510-86c6-baeb010256d2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.344259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.344876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.345189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.345467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.346196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.346502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.347943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.365753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 320/647] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.366555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.376087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.376848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.377234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.377576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/6e6a60e442924d9e92910b778414a60e/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.392763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=6e6a60e442924d9e92910b778414a60e, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.394247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.407345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 328/648] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:36:55 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/6e6a60e442924d9e92910b778414a60e/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:36:55.408065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.430242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.499194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbd6e-4c84-4d94-a269-3484e8e847ae None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.529023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c982f-daa3-4755-87bf-6d491801030b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.541296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.544948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.545684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.545967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.546278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.546925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.547241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.549021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.565167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 321/649] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.566412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.574559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.575205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.575482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.575753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.588517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.590011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:55.605771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:55.606740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:55.607641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:55.607641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:55.607641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:55.607641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 329/650] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:55.607874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.676666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b00b-09d8-4a13-9daa-7b0b1c782792 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.693927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.712294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.713051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.713406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.713748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.717665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2eca6-a26e-4588-b504-3ca0c7f1b2a9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.724864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.726452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:55.741356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:55.742529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:55.743746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:55.743746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:55.743746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:55.744581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 322/651] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:55.745282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.760116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.760738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.761050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.761330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.794956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:55.836464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.837974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.856409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9826bb-bb4b-4f5a-8fe9-f2db9dc473f1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:55.895229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:55.895836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:55.896112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:55.896412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:55.897315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=bab5524ecd44403bb82fd4d6433fb002) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:55.897623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:55.899045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:55.904856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 323/652] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/role_assignments?user.id=bab5524ecd44403bb82fd4d6433fb002&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:55.914159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.948000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 330/653] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:55.948732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:55.961206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.020518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.055417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c0a8-dac5-41a8-b5d6-a6b68f4a3533 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.077984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52d98-e220-4aac-b1e9-9f7ac465d137 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.101318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.102199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.102627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.103045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.105076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:56.105076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.105989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.119070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 324/654] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:56.119907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.127267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.128055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.128903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.129347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.130078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:56.130471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.132906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.148019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 331/655] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:56.149072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.234735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.246889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec8bd3-d5ae-483b-8edb-74785989aa79 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.266951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5b10-2e31-44f7-88dc-7f7788f850ba None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.292070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.293685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.294711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.295253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.295657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.307818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.309231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.309368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.310316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.310739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.311411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.321151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.322801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:56.325455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:56.326589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:56.327702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:56.327702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:56.327702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:56.331289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 325/656] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:56.332183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:56.339267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:56.340416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:36:56.341538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:56.344043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 332/657] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:56.349660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.439268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc9b3d-9a29-4aeb-86df-448aa4dfe27c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.458648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae803cf-ddc5-41eb-b7d8-8b1593d818d2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.475005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.475662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.475918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.476191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.484700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.486617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:56.500126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:56.502161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:36:56.503932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:56.506449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 326/658] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:56.507841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.509107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.509945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.510225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.510498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.511182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:56.511485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.512876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.514127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.531056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 333/659] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:56.531953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.576114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.623398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487cd2-2f9a-4196-8bad-260a1595aa3f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.639866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6a9e-e1cf-43f2-a334-a83053a4e673 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.664301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.664996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.665299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.665506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.666204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:56.666511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.668008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.676616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.677482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.678005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.678429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.679304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:56.679756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.681374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.690940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 327/660] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:56.690940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.704536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 334/661] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:56.706004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.760420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.802894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ccaa3-5812-4ba6-a39a-a465aad423e4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.806849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:56.810883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf05d-3f07-40c3-8d74-5bb9b2b50bde None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:56.842705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.843350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.843633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.843907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.851320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:56.851989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.852297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:56.852731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:56.853178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:56.853497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:56.865970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:56.867130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:56.868267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:56.871843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 328/662] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:56.872855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:56.925412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:56.927138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:56.984098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3703-faef-4715-b84b-8536ea9db15a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.009564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.024405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.025662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.026654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.027084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.027512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.032354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 335/663] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:57.033474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.107530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.109451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.134840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9f2a4-d07a-449a-9a55-a2f9eb203291 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.171635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.172248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.172526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.172798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.173719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:57.173917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.175376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.193372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 336/664] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:57.193372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.237254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 329/665] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:36:57.238925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.252425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.268012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.299891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764ca-3299-4c29-81c6-f5eca1e85802 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.337432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.338069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.338346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.338620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.348158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8d9b-64bb-4199-808c-6449544a790a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.350322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.351935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:57.367023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:57.368243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:57.369424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:57.369424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:57.369424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:57.372755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 337/666] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:57.373718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.385148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.385827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.386184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.386520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.387298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:57.387668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.389211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce4278-5c6c-4296-948a-edcb05fec9ae None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 330/667] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f2c1f-8acf-4485-90c9-dcae01ff49cf None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f2c1f-8acf-4485-90c9-dcae01ff49cf None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f2c1f-8acf-4485-90c9-dcae01ff49cf None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 331/668] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:57.402654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f2c1f-8acf-4485-90c9-dcae01ff49cf None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.508498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.520224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ee47-aedf-45c8-9566-5ba0015de047 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.527307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f2c1f-8acf-4485-90c9-dcae01ff49cf None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.537058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.572094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.572739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.573198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.573539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.573764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.574570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.574856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.575127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.575814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:57.576124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.577601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46a778-2f8c-4a73-b050-19a0bd70fb71 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.587588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.589002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.593212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 332/669] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:57.594605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.594954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.595214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:57.607580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:57.608803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:57.609803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:57.609803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:57.609803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:57.609803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 338/670] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:57.609803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.618821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:57.621090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:57.700305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 333/671] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:57.701616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.733015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b3170-959e-428d-96c1-40563871e36a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.769589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.770547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.770974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.771529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.779228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.780893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:57.792819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:57.793824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:57.794952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:57.797048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 339/672] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:57.806195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.806897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:57.828410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a241c3-c99e-41f0-8929-92bc4d8832ad None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:57.866537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:57.869968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:57.870827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:57.871308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:57.871923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:57.872944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:57.873488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:57.875100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:57.889763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 334/673] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:57.895351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.009779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899831e-84ef-41e3-8781-9ee226e12166 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.012931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61c11-caba-43aa-bae4-d4438c320afb None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.050718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.052060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.052544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.053196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.056936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.062866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.065333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.068882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.069711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.070126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.070551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.071376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.071925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.073519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:36:58.079479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:58.080879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:36:58.082042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:58.083545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 335/674] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:58.085310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.097418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 340/675] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.098450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.194401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd57a8d-85eb-47be-827d-ec50742b7d00 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.195527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.213380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034099-e352-473e-9a20-05ef638cd24e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.229782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.230424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.230707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.230978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.242999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:36:58.248153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:58.249344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 336/676] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:58.250525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.257449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.258069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.258346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.258614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.259430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.259737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.261189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2c90-eb06-4852-9780-c92e0f9ca7a6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.274864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 341/677] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.276709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76ee6-4000-47b6-a390-4b6384a353c7 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.277501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76ee6-4000-47b6-a390-4b6384a353c7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.277927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76ee6-4000-47b6-a390-4b6384a353c7 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.279792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 342/678] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:58.281067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76ee6-4000-47b6-a390-4b6384a353c7 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.309566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.356793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b37a-8a66-4c30-823e-5977b703b1b0 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.388757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.389385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.389661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.389930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.390644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=c1015e2218b14b85aba318460f6deb85) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.390946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.392359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.393469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76ee6-4000-47b6-a390-4b6384a353c7 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.397985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 337/679] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/role_assignments?user.id=c1015e2218b14b85aba318460f6deb85&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.398749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.441611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.442304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.442671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.443013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.443800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.444303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.445709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2b6e0-c193-46ce-80ba-c8a46444614e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.456247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 343/680] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.457420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.457701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.457975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.472661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.480910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:58.482161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:58.527227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349604-014f-4736-b90a-3e8793b19f72 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.549316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.570150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.570770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.571040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.571306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.572034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=aea417bef9414609b3c79bbf2cc2ced2) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.572389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.573803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.580918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 338/681] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/role_assignments?user.id=aea417bef9414609b3c79bbf2cc2ced2&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.581773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.585932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 344/682] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:58.712736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad401-1439-47e3-86ba-7624007d2f61 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.754669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.755679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.756281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.756751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.773610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.775129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:58.790539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:58.791570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:58.793227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:58.793227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:58.793227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:58.793227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 339/683] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:58.797784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.901611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:58.913486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2224d1b-c84b-4a25-9d3a-1788cf3f2375 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:58.952848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.954609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:58.955544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:58.955821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:58.956090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:58.956739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:58.957069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:58.958478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:58.961752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:58.974797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 345/684] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:58.981096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:59.066646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66c2-734c-4950-8cb5-73c83c0ede0f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.087755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bac-6ccd-4baa-ab4a-067f69d8f1b5 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.123705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.124337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.124623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.124891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] PATH_INFO: `/v3/users/swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.128080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.128950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.129464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.129935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.134846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.135396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.143889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.145732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:36:59.147297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:59.148225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:36:59.149198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 346/685] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:36:59.154347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:36:59.165149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:36:59.166115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:36:59.166998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:36:59.166998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:36:59.166998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:36:59.174591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 340/686] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:36:59.180817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:59.219367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:59.299544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:59.315265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c7eb-9050-4f07-8ff9-cb2e6e8aeb70 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.347134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6179-4ada-40c0-8518-70d4dc10312f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.360683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.362105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.362594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.363087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.364373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:59.364943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.366876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.385730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 341/687] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:59.387920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:59.451786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.452548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.452662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.452935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.453703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:36:59.454004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.455762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.500468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 347/688] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:36:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:36:59.510056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:36:59.512298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad82f9-1d98-4c0a-9a38-5e0ffed56ab5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.553071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.556332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.556851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.557412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.559996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.561670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafdafa-b8f0-49ae-84b2-247b03d835e0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.602946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 342/689] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:36:59 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:36:59.608997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5aa9-6109-49fc-b9bf-63d01e11bd89 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.609902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5aa9-6109-49fc-b9bf-63d01e11bd89 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.609902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca5aa9-6109-49fc-b9bf-63d01e11bd89 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.618364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 343/690] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:36:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:36:59.619816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.620097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.620365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.636690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:59.661192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:36:59.662784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:36:59.706981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551b90-77b1-4a52-94aa-4165fe610e03 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:36:59.740232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:36:59.784045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:36:59.785149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:36:59.785632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:36:59.786123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:36:59.790997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 344/691] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:36:59.858546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:36:59.860436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:36:59.965240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 348/692] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:36:59.976994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.071000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.084071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce31f2-c7bf-4516-b00d-fde6aeff8ba4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.092996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.141275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.141802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.142081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.142335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.149351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.163313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.164805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:00.191222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:00.192416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:00.193718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:00.193718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:00.193718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:00.193718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 345/693] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:00.199324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.240198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59563a-cd69-4d9a-b087-896484f403b9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.275346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.276075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.276350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.276620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.295530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:00.304859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:00.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:00.307642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 349/694] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:00.316988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.397583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe20a11-eacf-4c71-b3c8-df455a355dbd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.419499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.439616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.440236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.440551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.440824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.441551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:00.441965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.443420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.456748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 346/695] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:00.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f5db-946a-4f60-9ab1-140b81ab4a2c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.462356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.520512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.523385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.523892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.526165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.527073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:00.527609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.530291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.550820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 350/696] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:00.560165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.585062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.668542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e098-0a29-43b0-aa3e-43f98923fae8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.712247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.713540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.714179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.714866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.724175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.726469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:00.742971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:00.743924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:00.744830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:00.748945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 347/697] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:00.755276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.784919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcc51-675c-4884-a545-bec16ce68a12 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.854017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.854694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.854973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.855247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.858885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.866526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f70a5-630c-41ba-b00f-3e0b3781dcf3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:00.870795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.872278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.875908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-817a9441-ef3d-4f4e-9959-1eea7fc19900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:00.890967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:00.891959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:00.892901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:00.892901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:00.892901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:00.892901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 351/698] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:00.894516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc314e5-deea-480f-aad2-7827d0e670aa None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.894516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc314e5-deea-480f-aad2-7827d0e670aa None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.894516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc314e5-deea-480f-aad2-7827d0e670aa None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.900208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 352/699] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:00.902020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc314e5-deea-480f-aad2-7827d0e670aa None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:00.915132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:00.916071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.916592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.917087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.918137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:00.918700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:00.920389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df3ac0-ea66-493d-89fb-3b5be9f20215 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:00.940026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 348/700] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:00.942163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:00.942764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:00.943357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:00.963378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:00.964906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:01.025873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc314e5-deea-480f-aad2-7827d0e670aa None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.049009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 349/701] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:37:01.049491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.080018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.081555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.081931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.082784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:01.083190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.084821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e84d47-560d-4a18-9f0c-83925b0aaa9e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.102466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 353/702] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:01.103723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941270-5684-4e7a-85a0-b326fdb7405f None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.104009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941270-5684-4e7a-85a0-b326fdb7405f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.104337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941270-5684-4e7a-85a0-b326fdb7405f None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.105856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 354/703] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:01.111174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.111526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.111876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.131709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:01.133031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:01.160555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.168380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b977fb5-0813-4fc3-9d34-6de1aba48e27 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.185347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.216712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.217427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.217802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 355/704] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:37:01.217941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.218288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.219096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.219213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=6e6a60e442924d9e92910b778414a60e) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:01.219537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.221069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.233015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 350/705] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/role_assignments?user.id=6e6a60e442924d9e92910b778414a60e&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:01.386954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694372d-2e23-4b95-be48-f682b716e1d0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.408761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.430566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.433482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.433979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.434703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.455445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.457236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:01.478717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:01.479731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:01.480678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:01.484106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 356/706] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:01.502699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.554690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.571071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9b6d-660d-45b4-8925-93b15704440f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.608572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.609248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.609521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.609789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] PATH_INFO: `/v3/services/network` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.610379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.611745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:01.623450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:01.624541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.625997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 351/707] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:01.626798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.634622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7abab-e522-4267-98a9-9e99e444dfaa None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.658623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.674534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.675301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.675642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.676016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.676818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:01.677205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.679159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.700702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 357/708] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:01.701770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.756461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7378d-2072-4f07-88df-0c088794182b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.801181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.802387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.803277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.803988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.804756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.806416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.807859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.813348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838118-de44-46f4-ab55-09c2187198e6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:01.819999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:01.821003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:01.821860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:01.826492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 352/709] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:01.828027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.860182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:01.861196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:01.861692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:01.862160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:01.863011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] RBAC: Adding query filter params (name=network) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:01.863520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:01.865432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:01.871580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 358/710] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:01.872688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:01.968533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:01.985222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af02824-fe3a-4c29-9144-1e2051066aa3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.007515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896106-0cf1-49ac-adff-af1d0da708cc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.029176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.029885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.030232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.030575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.045942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.046548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.046823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.047088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.047706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:02.048003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.049428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.053867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 359/711] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:02.054648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:02.081356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:02.109621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.111231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90309f29-3f8e-4471-864f-d0921ca26d6f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.166887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d9b52-6e71-4b38-9f56-1848747ab72f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.202394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:02.208218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.209486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.209875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.210278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.211022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] RBAC: Adding query filter params (type=network) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:02.211422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.212886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.229011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 353/712] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:37:02.229011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97dfc-2f27-40a2-8360-03f71806fc81 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.229011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97dfc-2f27-40a2-8360-03f71806fc81 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.229011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97dfc-2f27-40a2-8360-03f71806fc81 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.229491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 360/713] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:02.229491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:02.229646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 354/714] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:02.229646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c97dfc-2f27-40a2-8360-03f71806fc81 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:02.344449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:02.359608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619191-dedf-4e0d-9833-f98d5f789b6c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.364457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c97dfc-2f27-40a2-8360-03f71806fc81 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.400320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.401107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.401455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.401801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.402504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:02.402876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.403980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.404451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9ddc-c584-4684-9dc4-a2b355d2eb0c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.404740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.405121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.405450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.410218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 361/715] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:02.411756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.411949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.412225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.421967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.424129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.433425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:02.434719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:02.443049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:02.444373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:02.445410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:02.445410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:02.445410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:02.448406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 355/716] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:02.462249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:02.566051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:02.600640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 362/717] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:37:02.650263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d139-4ad2-4f56-b97c-3bd7c184d885 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.686074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.686687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.686968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.687239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.687887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:02.688253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.689657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.706504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 356/718] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:02.712147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:02.850019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:02.876915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8f67e-fb9c-4006-a8f3-82424ab700e1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:02.926698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:02.927335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:02.927731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:02.928068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:02.939428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:02.940932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:02.956494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:02.957535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:02.958477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 363/719] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:02.965215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.047027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.119218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:03.122690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e96f-ce82-4cd5-b224-0ba6b721e9eb None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:03.194756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:03.195227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.195507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.195774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.196838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:03.197163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:03.198600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:03.215418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabccce-9127-44eb-a814-8b27e06f0d47 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:03.218031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 357/720] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:03.223826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.252545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:03.253612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.254090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.254629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.266309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:03.272008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:03.272940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:03.273833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:03.281274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 364/721] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:37:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:03.282802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.286915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:03.326607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edfff-2c1f-4298-9ede-a3c72f4dc406 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:03.361539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff160-1113-4843-9514-da178157ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:03.362352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff160-1113-4843-9514-da178157ef34 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.362641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff160-1113-4843-9514-da178157ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.362910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff160-1113-4843-9514-da178157ef34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.363643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff160-1113-4843-9514-da178157ef34 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:03.363947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff160-1113-4843-9514-da178157ef34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:03.365505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff160-1113-4843-9514-da178157ef34 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:03.372109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 358/722] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:03 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:03.491157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407bd80-4c6d-4cf0-b6f3-719522968853 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:03.544417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:03.545075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.545339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.545611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.546279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:03.546578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:03.547962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380087b0-34c2-4b73-bc1d-46bd978a3848 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:03.557199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 365/723] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:03.566335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff160-1113-4843-9514-da178157ef34 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.598801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:03.615378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33645c4-7bec-4f08-a5d1-030b683feb23 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.615707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33645c4-7bec-4f08-a5d1-030b683feb23 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.616103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33645c4-7bec-4f08-a5d1-030b683feb23 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.617623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 366/724] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:03.627072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.627339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.627609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.656962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:03.658190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:03.733685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff160-1113-4843-9514-da178157ef34 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:03.783914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:03.797212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 367/725] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:37:03.800116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:03.800757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:03.801060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:03.801329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:03.812493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:03.813970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:03.828239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:03.829302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:03.831201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:03.831201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:03.831201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:03.831201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 359/726] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:03.835896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:03.957155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c801-b5c2-4b26-930d-3bcefb367467 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.007617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.008601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.009101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.009616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.010472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:04.010984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.012557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:04.027549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 368/727] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:04.033114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.145097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.176310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1244d-34f4-428c-8fcf-ad1e6ee47632 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.222955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.223588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.223863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.224131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.232247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.233763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-5947baad-d5b6-4941-9dc3-e3040c55a167 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:04.245211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:04.246218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:04.247741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 360/728] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:04.252359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.325432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d38f0-2fcb-4222-8c1f-58df40edd369 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.325758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d38f0-2fcb-4222-8c1f-58df40edd369 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.325974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d38f0-2fcb-4222-8c1f-58df40edd369 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.327309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 361/729] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:04.329963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.332537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.332832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.333236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.360141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:04.361354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:04.407652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87889b-51ad-40f1-a197-1693bc102077 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.445175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.445442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 362/730] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:37:04.445800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.446132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.453466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.453755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.454625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:04.454941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.456821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:04.507807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 369/731] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:04.514150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.529678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.566700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04481-2589-4c9f-8fd5-8eb4017e7902 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.605110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.605930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.606594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.606974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.618725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:04.623941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:04.625034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:04.626046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 363/732] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:04.637970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.688078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4697e4-868f-4053-83d9-ee0c61f2c1ef None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.705673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.733048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.733829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.734210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.734586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.762345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaaf4e-85a6-4494-af28-05e61b5cc051 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.789804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.800745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.801673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.802131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.802628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.803482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:04.803954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.805705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447343-198b-4ff6-b785-f6c9c983d584 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:04.814984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 364/733] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:04.816335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1601-5917-4ccb-af3e-40c7c92e5191 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.816877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1601-5917-4ccb-af3e-40c7c92e5191 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.817324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1601-5917-4ccb-af3e-40c7c92e5191 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.819068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 365/734] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:04.819784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.820626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1601-5917-4ccb-af3e-40c7c92e5191 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:04.821497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab6df-4378-4191-80dd-b0318693d5e5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:04.923188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 370/735] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:37:04.927783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.927783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.927783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.932961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1601-5917-4ccb-af3e-40c7c92e5191 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:04.944017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:04.945388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:04.953127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:04.970958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:04.971589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:04.971866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:04.972177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:04.984324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:04.985849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:05.001124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:05.002118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:05.003008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:05.003008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:05.003008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:05.003008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 366/736] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:05.003256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.028995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 371/737] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:37:05.028995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.059009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.122644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7564f-7455-4511-83cd-30b946c3dbd3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.157819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d5a0-2453-4c92-80b2-6f635663d11c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.159309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.160017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.160388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.160748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.161524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.163138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.184865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 367/738] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:05 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:05.185879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.215074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.216135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.216659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.217181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.228882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.234610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.237597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:05.257787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:05.259255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:05.260174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:05.260174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:05.260174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:05.260360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 372/739] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:05.265548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.314805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.319003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad1ba-8739-4e4d-920a-80e75ca064e7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.358672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.359765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.360249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.360720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.361787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:05.362312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.363899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.376153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e998-47df-4392-b4b9-a78e80b24906 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.378342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 368/740] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:05.384097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.412200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.412831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.413147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.413422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.414080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:05.414381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.415837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.428928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 373/741] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:05.447511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.504278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbf84-5ae0-4d66-b2eb-0e52564eab73 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.518517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.550328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.550958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.551231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.551498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] PATH_INFO: `/v3/users/swift` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.560864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.562500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.578593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826a0b-2dac-4fc8-acaf-6899f746b8da None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:05.579499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:05.581158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:05.582803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:05.583369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 369/742] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:05.584131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.607452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.619488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.620179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.620456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.620723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.627876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.629746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-5e2bc194-93da-4ba5-a7f8-b6b256fa942c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:05.641700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:05.642639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:05.643516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 374/743] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:05.644009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7166-6fa8-4ffd-8619-bcf94258773d None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.644650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7166-6fa8-4ffd-8619-bcf94258773d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.644650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7166-6fa8-4ffd-8619-bcf94258773d None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.649484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 375/744] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:05.649484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7166-6fa8-4ffd-8619-bcf94258773d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.697887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662e78-2630-43e8-9710-d527c4df335c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.732039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.732896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.733541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.733817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.734465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.735848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.752392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 370/745] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:05 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:05.753451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.779084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7166-6fa8-4ffd-8619-bcf94258773d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.791926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.832993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.834816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.835396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.835992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.837140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:05.837691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.839400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4c200-95de-419e-814c-d74800818877 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.857237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:05.864799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 376/746] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:05.866535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.867017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.867508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.882422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeae30-3da2-4b9d-862c-183ba068044d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:05.891838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:05.893908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:05.921864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:05.922476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:05.922752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:05.923016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:05.923704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:05.923995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:05.926234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:05.946789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 371/747] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:05.946789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:05.981510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 377/748] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:05.990564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.074454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:06.081039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d019b0-d5cc-4fae-b670-30cabdfcd1a7 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.117725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.118313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.118588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.118858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.122735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=d5525e62e4114ce588a9e0649835442a) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:06.122735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:06.122735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:06.127115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 378/749] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/role_assignments?user.id=d5525e62e4114ce588a9e0649835442a&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:06.136943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29737-2cd6-41ae-838e-7d1d59de61a2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.181914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.182860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.183287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.183724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.196121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:06.273172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:06.274935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:06.290625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.397471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 372/750] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:06.403065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.446898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:06.519904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693dca-04cd-44ee-969d-12d0d2d2ad1a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.554904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f93f0-538e-4be6-8aab-c399946331e4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.557856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.558503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.558785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.559061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.569726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:06.571195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:06.586570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:06.588174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:06.589354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:06.589354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:06.589354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:06.589354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 373/751] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:06.593458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.645639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.646324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.646603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.646869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.689655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:06.690797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:06.694907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:06.695853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:06.696716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:06.698708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 379/752] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:06.706354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba656-8095-4c8a-9a7f-074cda6b81fd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.714403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.742926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.743542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.743822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.744096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.744740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:06.745072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:06.746459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:06.759004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 374/753] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:06.760360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:06.764434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.878521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e782-66bc-42d9-9d32-07da697d15c8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.919842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.920461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.920742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.921059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:06.921877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:06.922184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:06.923929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:06.929754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2d4f-a2d7-431d-847f-fc2d3549cf17 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:06.934049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 380/754] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:06.942049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:06.994503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:06.995134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:06.995405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:06.995670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.011696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.013179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:07.032317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:07.033498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:07.034657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 375/755] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:07.042031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.080849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.093328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.129312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7aa49c-26e1-464b-adba-21f2708ab424 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.165468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.166125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.166403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.166669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.180216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.181695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:07.196794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:07.197820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:07.199398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:07.199398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:07.199398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:07.199398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 381/756] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:07.204063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.267206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49bb96-3115-4382-8116-99f47f24071e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.313366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389079b-194f-402b-b47c-f4f4df84fcd1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.346057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.350527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.351168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.351443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.351709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.352368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:07.352865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.354520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.369755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 382/757] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:07.374873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.426236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.426867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.427147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.427481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.428262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:07.428568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.430063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.467338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 376/758] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:07.473933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.479539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f21d1-281e-4d37-8641-217f6c587558 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.534628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.535270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.535551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.535826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.545877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.547687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-af29c0d6-6063-4161-816e-d4626c7f84c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:07.561135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:07.562102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:07.563033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:07.565783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 383/759] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:07.567443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e48f-ccbd-43dd-b88d-612ba774b186 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.567943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e48f-ccbd-43dd-b88d-612ba774b186 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.568449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e48f-ccbd-43dd-b88d-612ba774b186 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.574354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 384/760] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:07.575483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e48f-ccbd-43dd-b88d-612ba774b186 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.582260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.615579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cdf9f-4184-475e-97dc-29d5fbd2951e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.638850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.650728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.651347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.651630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.651893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.652620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=6e6a60e442924d9e92910b778414a60e) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:07.652983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.654428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88985f4-89a6-4384-8319-45e3e13324bc None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.660714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 377/761] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/role_assignments?user.id=6e6a60e442924d9e92910b778414a60e&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:07.662542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.663007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.663458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.684366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:07.685653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:07.724764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e48f-ccbd-43dd-b88d-612ba774b186 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.763345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 378/762] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:07.798690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.799601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.800125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.800561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.801499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:07.801947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.803775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.823076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 385/763] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:07.832492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:07.899158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:07.934933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025a453-b37d-4505-80f0-95c849a86701 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:07.970461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:07.971103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:07.971380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:07.971647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:07.983105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:07.984492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:07.999799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:08.000831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:08.002281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:08.002281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:08.002281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:08.002281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 379/764] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:08.007062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.109575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.171745 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea66b4-3f19-49c8-b4d2-179ca5e76f9b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.184308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.214810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.216233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.216658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.217114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.218379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:08.218870 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.221099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e4d7-8c65-46df-b748-38396939e05e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.236585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 386/765] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:08.238482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c4b83-2d66-46cc-9549-589f03d739d4 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.238898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c4b83-2d66-46cc-9549-589f03d739d4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.239414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c4b83-2d66-46cc-9549-589f03d739d4 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.240836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 387/766] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:08.246114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c4b83-2d66-46cc-9549-589f03d739d4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.256033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ecee0-f209-40b9-8a62-fd8b7971358d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.277461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.302721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.304330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.304815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.305315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] PATH_INFO: `/v3/services/network` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.306547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.308856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d0776e6c-c604-47c6-9d80-ddd089dab920 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:08.321754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:08.322839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:08.323685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:08.331485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 380/767] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:08.331485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae405d8-72c8-48e9-b731-9be9901aea4c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.331485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae405d8-72c8-48e9-b731-9be9901aea4c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.331485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae405d8-72c8-48e9-b731-9be9901aea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.358135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-bae405d8-72c8-48e9-b731-9be9901aea4c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:08.360368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bae405d8-72c8-48e9-b731-9be9901aea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:08.381734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c4b83-2d66-46cc-9549-589f03d739d4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.418326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.418951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.419227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.419495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.426432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.427944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:08.439279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:08.440200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:08.446280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 388/768] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:08.446783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 381/769] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:08.446858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.446936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15da21-69df-44d4-af08-afa8681819cb None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.446936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15da21-69df-44d4-af08-afa8681819cb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.446936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15da21-69df-44d4-af08-afa8681819cb None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.449361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 382/770] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:08.450425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15da21-69df-44d4-af08-afa8681819cb None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.481271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.563658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23730-1930-4916-854f-dc3356966bbb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.595300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15da21-69df-44d4-af08-afa8681819cb None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.606637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.607791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.608293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.608837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.609331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.611559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] RBAC: Adding query filter params (name=network) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:08.612054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.614214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42d920-a999-470d-a486-b49a0a82de5c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.622384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 389/771] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:08.624432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.625179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.625635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.631899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.632641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.633004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.633340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.634298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:08.634669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.636246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.648830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:08.654130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 383/772] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:08.654130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.654333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:08.726136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 390/773] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:08.726951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.756240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.783606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c5e6-9928-40a6-a999-1071295f8f47 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.820008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.820668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.821229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.821347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.821957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] RBAC: Adding query filter params (type=network) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:08.822255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.823673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.830706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 384/774] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:08.831642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.841842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959aaeb-b660-4b4e-be32-14640fa950e9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:08.871056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:08.883231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:08.883904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:08.884177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:08.884448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:08.887490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=51f86708703f4f86953e188c3bac4c58, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:08.890325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:08.917021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 391/775] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:08 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:37:08.917021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:08.983042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12fb-c33d-471b-aab0-74a8ab810e20 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.019622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.029454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.030196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.030475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.030747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.031385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.033413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.042351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ecbff-e05a-47a3-8303-277d3713df19 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:09.043497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:09.044502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:09.045395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:09.049853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 385/776] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:09.050812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.087646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.088286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.088560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.088823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.089715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] RBAC: Adding query filter params (interface=public, service_id=12047c6a74884ba0bcfbf00b4042a46f, region_id=RegionOne) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.090036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.092308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.102113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 392/777] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:08 2022] GET /identity/v3/endpoints?service_id=12047c6a74884ba0bcfbf00b4042a46f&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:09.103101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.171166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.174443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c307-84d7-4316-b4ac-c0d262868b30 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.210325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.210965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.211245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.211518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.224657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:09.231124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:09.232139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:09.233039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:09.234484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd948-0b0e-46ec-8494-d3b4397ff43c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.237045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 386/778] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:09.238308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.273582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.274530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.275032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.275502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.276324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.276825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.278424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.288114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 393/779] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:09.288114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.304190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.347603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c495ce-0f55-4638-9cac-fddc35392c71 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.385785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.386384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.386668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.386942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.387746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.388923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.394752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 387/780] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:09.395557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.397923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f51-d228-4760-974e-51a5c37f9e3b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.437905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.438939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.439435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.439978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.440924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.441486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.443179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.458127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 394/781] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:09.459896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.470562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.542234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.571318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c9f0-e9c9-4c89-a20c-0cb97e4a288f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.610000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d19a-f95c-49f5-98b8-66ac00157996 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.611854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.613438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.613817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.614193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.627217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.629335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:09.647513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:09.648536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:09.649485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:09.649485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:09.649485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:09.649659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.650547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.650547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.650836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.656989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.656989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.656989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.657542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 395/782] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:09.657542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.658779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 388/783] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:09.665119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.761387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.762377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73d0f6-df06-497b-995b-b1c7a78e919e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.777007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427069f-943d-4ee0-924a-da8a4733aa0d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.788875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:09.797826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.798378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.798651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.798925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.799569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.799869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.801350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.827164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:09.829294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:09.830951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 396/784] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:09.831500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:09.831999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:09.832915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] RBAC: Adding query filter params (interface=public, service_id=499cc73010cf46108151ca083041fa9d, region_id=RegionOne) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:09.833542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:09.835379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:09.837986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.854430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 389/785] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/endpoints?service_id=499cc73010cf46108151ca083041fa9d&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:09.861023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:09.975680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681676ac-4893-4cef-85fe-553d2ba4b32a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:09.990511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b6966-d869-4db0-82ca-b416c97c9605 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.024872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.025601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.025885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.026160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.029660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.030525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.031043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.031673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.032553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.034071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.034467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84ce45-4724-4c06-a15b-550f911b5560 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.035572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:10.049024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:10.050155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:10.051352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:10.052090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 390/786] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:10.055264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931117-24a4-42be-b630-2caea1c4734f None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.055264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931117-24a4-42be-b630-2caea1c4734f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.055264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931117-24a4-42be-b630-2caea1c4734f None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.055536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 397/787] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:10.056222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 391/788] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:10.056330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.077226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.077657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.078125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.114635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:10.117698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:10.118933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:10.147077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:10.184962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d93-1c69-4a98-84dd-d1a0692e80fc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.226436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.227312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.227594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.227868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.229066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:10.229383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.231082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.257055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 398/789] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:10.260051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.274755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 392/790] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:10.366468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2711f-edcc-48f2-8fdd-bd4b0c0cafcb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.369066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:10.402581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.403338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.403540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.403814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.414438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.415905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:10.430747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:10.431718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:10.432616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:10.432616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:10.432616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:10.436300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 399/791] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:10.442057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.587040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d8200-0d9f-402d-b4d6-6f428ea822a3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.634721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.635581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.636009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.636447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.637272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:10.637722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.639246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.642682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.652780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 393/792] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:10.658078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.667950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:10.824548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152398-5efb-4024-86aa-9b5fcf1ef0db None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.862361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971baf5d-330c-421b-bf60-8179c3fd715c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:10.872069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.872810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.873125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.873394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.884477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:10.886033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:10.910302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:10.911262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:10.912491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 394/793] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:10.919519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:10.941010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:10.941651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:10.941927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:10.942193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:10.974103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:10.979468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:10.980393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:10.981981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 400/794] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:10.990054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.016469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.034949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.061066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90854-4e7f-4aeb-a0b2-864c256df39d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.099342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.100340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.100824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.101349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.102712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:11.103231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.105443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.125517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 395/795] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:11.127027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.248154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03769-0d06-4125-b1d2-e630d2cb1eed None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.287213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.287985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.288272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.288549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.289264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:11.289571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.290976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245bef-3a64-45d7-b2bb-f219bb2d0094 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.305238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 401/796] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:11.306598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76110c-cb3f-4964-9c2f-60e6b39fc5d5 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.306896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76110c-cb3f-4964-9c2f-60e6b39fc5d5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.307236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76110c-cb3f-4964-9c2f-60e6b39fc5d5 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.308743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 402/797] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:11.309473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76110c-cb3f-4964-9c2f-60e6b39fc5d5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.371765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66bb9-d13b-4a60-85c4-5c2539b77db0 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.397569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.402618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.409500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.410556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.411064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.411524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/d5525e62e4114ce588a9e0649835442a/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.426909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=d5525e62e4114ce588a9e0649835442a, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.427513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76110c-cb3f-4964-9c2f-60e6b39fc5d5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.429226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb129-3625-4b87-a753-375d30496115 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.449254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 396/798] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:11 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/d5525e62e4114ce588a9e0649835442a/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:37:11.451159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a541-1b71-4c94-89ca-fc410da1a2e1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.451635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a541-1b71-4c94-89ca-fc410da1a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.452093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a541-1b71-4c94-89ca-fc410da1a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.481016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.481016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.481016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.481016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.482860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-78e7a541-1b71-4c94-89ca-fc410da1a2e1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:11.484427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-78e7a541-1b71-4c94-89ca-fc410da1a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:11.520379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.521840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:11.558271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:11.559327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:11.560876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:11.560876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:11.560876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:11.560876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 403/799] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:11.565514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.569703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 397/800] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:11.644635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a31-3b89-4a1e-9a08-558074e78ea1 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.645001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a31-3b89-4a1e-9a08-558074e78ea1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.645227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a31-3b89-4a1e-9a08-558074e78ea1 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.646890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 398/801] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:11.652337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.652626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.652885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.671489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:11.672672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:11.683403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ec85-ea41-4c05-a9ca-c45fc86e3152 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.726738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.732639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.733780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.734200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.734843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.735614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:11.736449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.738105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.760902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 399/802] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:11.761122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 404/803] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:11.762594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.826933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:11.916992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68980a4a-c567-473b-9eef-b539319603f9 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:11.953006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:11.954010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:11.954765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:11.955048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:11.955626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:11.970455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:11.971919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:11.990726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:11.991755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:11.992720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:11.996022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 400/804] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:12.006562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.157254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70afe-0666-4bd4-a1ed-0689d53a7de4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.158101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.164731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630a18-f3e3-4ef8-801d-d8deb832b3b8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.199087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.199724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.200001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.200271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.206749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.207627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.208113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.208704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.209692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:12.210201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.211578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:12.212070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:12.216591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:12.217707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:12.218558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:12.222767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 405/805] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:12.223640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.235637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 401/806] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:12.241460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.280817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.341066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485af5c-d395-4661-8071-90cf53f8791b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.344830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d306-d67e-413a-aee7-af3c5deccd41 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.379089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.379724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.380002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.380269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] PATH_INFO: `/v3/services/network` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.380905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.381195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.382037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.382335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.382713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.383243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.384110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:12.384608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.386178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:12.393645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:12.394659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:37:12.395587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:12.398664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 402/807] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:12.399801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.401303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 406/808] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:12.404069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.420864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.511205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e376a6-854d-4c84-adf3-919d86815331 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.515533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb09f6-e34c-4535-9273-9b1ed542fe8b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.530740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.549123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.549919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.550200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.550563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.551994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.552782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.553265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.553612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.563253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.564345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.565106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.565830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-b7ee6ed3-36ef-4036-9ac6-60958c87a467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:12.581014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:12.582190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:12.583708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:12.583708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:12.583708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:12.589043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:12.590154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:12.591162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:12.591162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:12.591162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:12.591162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 407/809] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:12.591162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 403/810] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69297-b138-4865-86eb-a6e8acce897a None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69297-b138-4865-86eb-a6e8acce897a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69297-b138-4865-86eb-a6e8acce897a None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 404/811] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:12.591458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69297-b138-4865-86eb-a6e8acce897a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.669570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.695805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fdbf0-cae7-455f-84b4-a305784a58c1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.710875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69297-b138-4865-86eb-a6e8acce897a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.733779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.734402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.734683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.734958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.735589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] RBAC: Adding query filter params (name=network) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:12.735922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.737361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.747190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 408/812] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:12.747190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.759902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.760517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.760792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.761090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.761851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:12.762149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.763516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74146e-0151-4d04-b1b2-c2f577c89fbb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.780790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 405/813] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:12.780790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.780790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.780790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.792369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.800733 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:12.801990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:12.868667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0078cf-38e0-4f2b-94a6-f03e691966be None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:12.873200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 406/814] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:12.873200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.908538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:12.909325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:12.909603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:12.909889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:12.910510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:12.910865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:12.912536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:12.926136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 409/815] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:12.927126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:12.946202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:12.997067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec6c25-1cea-41e9-a945-9ea1b5e7d696 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.037086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.051414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11279-cc58-48de-bdaa-c2093c899eaa None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.056188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.056815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.057122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.057395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.058036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] RBAC: Adding query filter params (type=network) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:13.058424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.059863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.065666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 407/816] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:13.066552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.105803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.106834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.107304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.107776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.117376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.119539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:13.134188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:13.135087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:13.135973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:13.138570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 410/817] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:13.139624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.173235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd47694-c833-4dc6-a509-bb233dc542f3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.197517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.212940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.213603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.213881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.214147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.221545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.222999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:13.235632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:13.236683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:13.237667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:13.241101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 408/818] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:13.242317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.257540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba289b-0e56-482b-9529-5c8532a0ef67 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.291344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.291959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.292235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.292505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.293192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.294564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.325006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 411/819] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:13.325006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.334217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.375150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96904a0-0a2b-4713-a1ee-969cdde212f4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.435122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.435928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.436305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.436699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.437547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:13.437999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.439652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.453129 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576baf-1211-465c-9dad-0d466351211d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.454634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 409/820] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:13.456042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.503092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.504445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.505307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.505749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.506172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.507525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.509255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:13.519069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:13.520316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:37:13.521393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:13.523586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 412/821] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:13.524606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.594383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00dc5d-054f-4646-b673-0c3fd16ffb44 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.629834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.637690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.638317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.638597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.638865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.639598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:13.639884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.641355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.663966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 410/822] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:13.663966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.669618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be0ee-e8d0-4435-9657-d0ec9bd88f54 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.702336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.702989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.703324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.703540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/6e6a60e442924d9e92910b778414a60e/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.705765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=6e6a60e442924d9e92910b778414a60e, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.707204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799ec29-deda-485b-bc81-6991d4783998 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.719818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 413/823] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:13 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/6e6a60e442924d9e92910b778414a60e/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:37:13.720998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12e94-cb5b-4783-b301-51f51b67e022 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.721297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12e94-cb5b-4783-b301-51f51b67e022 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.721570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d12e94-cb5b-4783-b301-51f51b67e022 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.722795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 414/824] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:13.723510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12e94-cb5b-4783-b301-51f51b67e022 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.760041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.769316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438fa6-178c-49ff-91cc-56d57dc01730 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.808828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.809489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.809767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.810037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.810675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:13.810974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.812362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779651f-cdd2-41f6-b7c2-0995c1825556 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:13.817458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 411/825] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:13.818750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.819032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.819301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.840066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:13.841308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:13.854122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d12e94-cb5b-4783-b301-51f51b67e022 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:13.886155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:13.892714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:13.893466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:13.893879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:13.894152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:13.921044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 412/826] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:13.921044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:13.980321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:13.981779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.037463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.051135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a0de5-2254-49df-a0dd-c9df4de13840 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.092481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 415/827] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:14.094443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.098480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.099231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.099579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.099913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.100612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:14.101039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.102516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.108231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 413/828] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 11:37:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:14.113634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.130658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.212631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8846-f4fb-4ea3-9de3-12011518584f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.231610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99294af-162c-41f0-a5e0-c83dedeecdd5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.248555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.249220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.249510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.249777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.260251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.261777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.271169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.272101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.272384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.272659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.273380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.274748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:14.276589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:14.277668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:14.278640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:14.278640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:14.278640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:14.281399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 416/829] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:14.282723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.299194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 414/830] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:14.300131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.320923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.408114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.430212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb6612-c1d1-4bd9-82ec-1cd08f6ba0d7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.434516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489484e3-de7f-47cf-8035-d43a6e7711ae None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.481842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.482387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.482676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.482951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.483612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:14.483902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.485346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.487667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.489980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.490436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.490853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.501008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 415/831] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:14.506332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.508066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:14.513489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:14.514528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:14.515672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 417/832] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:14.523781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.591091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.629953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d8ad-f923-420a-98d4-6c811df88d5f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.653467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5eb03-afcd-470b-a3ec-a418d8ba60eb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.677061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.679039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.679708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.680124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.689633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.690037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.690456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.690822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.691178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.691929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:14.692273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.692385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.694079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.707981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 418/833] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:14.709555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:14.710607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:14.711778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 416/834] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:14.712386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.718471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.719143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.826592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73cb67-c097-4404-bdd3-103cf7397ad8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.850334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95674a98-d70b-457b-a752-b43d87e294c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:14.863613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.864408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.864813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.865206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.876933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.878547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.886489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:14.893572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:14.894160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:14.895467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:14.896781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:14.896781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:14.896781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:14.897062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:14.897062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:14.897062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:14.897062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:14.897062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:14.897688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:14.897957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 419/835] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:14.903903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.919807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 417/836] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:14.921779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:14.978898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:15.044684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373394d3-e059-4774-8bf2-c31830529575 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.044927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e3df-27d6-4b1f-a333-a09779e7b9cb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.082186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.083095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.083603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.084208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.085054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:15.085555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.087150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.093747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.094360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.094639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.094909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.095635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:15.095945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.098039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.102813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 420/837] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:15.108297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:15.109826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 418/838] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:14 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:15.226160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55437-219c-4bfa-bdb3-0c0b69db62b2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.244037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:15.263377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.264017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.264291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.264557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.272675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.274173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:15.286752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:15.287904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:15.288853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 421/839] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:15.298403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:15.353458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:15.410104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4238-891e-494b-a6ec-ebb1ee1c5bb9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.444893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.445558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.445884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.446160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.446900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:15.447207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.448651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d61403-74c0-4c65-b038-c3752982d8ca None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.472348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 419/840] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:15.475323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:15.582442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cd507-74e2-408f-a364-2fcbe567b41a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.618026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.618615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.618899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.619177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.666551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:15.691438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.693168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.715177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0751-5503-4fbe-b077-277e3aba5248 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.715505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0751-5503-4fbe-b077-277e3aba5248 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.715723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0751-5503-4fbe-b077-277e3aba5248 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.717323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 420/841] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:15.722191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.722471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.722739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.741222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:15.742419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:15.817374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 421/843] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:15.821096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 422/843] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:37:15.823240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:15.869570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:15.926625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024ac2f-311d-45f1-a07a-280e84987708 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:15.962544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:15.963184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:15.963463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:15.963734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:15.973963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:15.975562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:15.991743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:15.992723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:15.993676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:15.993676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:15.993676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:15.996882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 422/844] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:15.999066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.079867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.080692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.110395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68e34-1e33-40e5-b0dc-593e12ad1d61 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.153768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.154296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.154568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.154835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.155476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:16.157278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.158910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.179181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 423/845] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:16.181108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.181635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.194969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76eae-7051-4fd8-952d-95ef8a87e1f3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.237646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.238675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.239154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.239626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.250870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:16.256539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:16.257557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:16.258427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:16.261126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 423/846] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:16.266742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.307399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc24a-33d9-472c-9f91-252ff98bce4d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.344957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.345710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.345977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.346247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.349713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.354670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.356118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-806b482f-3444-4680-958f-69c3b9f1ab72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:16.367439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:16.368367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 424/847] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:16.370014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b50c9-8b66-4e36-9339-1553425b988f None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.370565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b50c9-8b66-4e36-9339-1553425b988f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.370565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b50c9-8b66-4e36-9339-1553425b988f None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.371865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 425/848] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:16.376501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b50c9-8b66-4e36-9339-1553425b988f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.385414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34d8b6-1a04-4925-b93d-9fbfd11787c1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.420171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.420805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.421153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.421490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.422332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:16.422724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.424142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f31415-afb0-46b5-981e-80c896a2ccf3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.437049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 424/849] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:16.437049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.437049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.437049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.453198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:16.454466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:16.462525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.485495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b50c9-8b66-4e36-9339-1553425b988f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.524667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.525303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.525580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.525850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.526538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:16.526838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.528269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.529100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 425/850] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:16.530508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.545752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 426/851] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:16.546677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.605185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.651920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9d7ec-a11e-4db3-9bbd-170e8dc9a03d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.671278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7a557-9dc9-4843-bddf-4f0f5a18d32b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.690635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.691550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.691662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.691957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.692759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=d5525e62e4114ce588a9e0649835442a) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:16.693165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.694744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.709606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 427/852] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/role_assignments?user.id=d5525e62e4114ce588a9e0649835442a&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:16.715825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.716804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.717286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.717741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.730905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.732748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.735098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:16.752170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:16.753264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:16.754165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:16.754165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:16.754165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:16.756530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 426/853] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:16.763327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.791412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:16.914555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a375b-e276-4d67-9ee7-1d8af4678d84 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:16.961736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:16.962364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:16.962646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:16.962917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:16.963510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:16.964910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:16.975170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:16.976215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:16.977100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 427/854] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:16.982917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.030013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04f16-57c5-4250-972f-07c049202c94 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.053593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.055464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.073109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.073759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.074040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.074312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.074964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:17.075267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.076664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.090136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 428/855] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:17.095173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.108456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abba89-a3b5-4cc4-ad1e-3014996593c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.144617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.145657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.146580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.147071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.147911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:17.148427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.150027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.155353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 428/856] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:17.162720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.204849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845df4d-f818-442f-a629-38a3ea072f4b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.241053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.241716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.242058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.242388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.250821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.252431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2ef7b651-f228-4d8d-88c0-d3ec43b39c6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:17.264526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:17.265712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:37:17.266869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:17.268185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674add5-43e4-4600-973e-cb57900a00db None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.269218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 429/857] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:17.270617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9530-04cb-483e-b46f-c0546e600378 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.270922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9530-04cb-483e-b46f-c0546e600378 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.271296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9530-04cb-483e-b46f-c0546e600378 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.272676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 430/858] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:17.277871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.278151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.278418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.297778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.299573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:17.300819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:17.310476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.311208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.311587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.312013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.312771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:17.313206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.314670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.329004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 429/859] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:17.329004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.360334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.401180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 431/860] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:17.458583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb02e1-4804-46f2-b9c2-471e659d1538 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.501065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.501596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.501874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.502146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.502888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:17.503192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.504621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.524353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 430/861] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:17.530021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.634944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1977ba9-40be-49ba-afc1-0efc3056afd8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.677713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.678725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.679195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.679657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.692071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.721822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.745538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.750535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.752064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.806722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0012a-bb47-4e45-bb59-d9b82d44ce42 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.846328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:17.847468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:17.847939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:17.848417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:17.849312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:17.850868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:17.851428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 432/862] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:17.860482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:17.861631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:17.862521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:17.863247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.864073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 431/863] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:17.872821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:17.957115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.988404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681798d-c48b-4488-b27d-39a37bad9114 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:17.999073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:17.999714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acf167-41e4-4f14-83b1-c645e58417f5 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.035496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.036020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.036297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.036595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.037556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:18.037862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.039235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.044308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 432/864] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:18.045855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.046481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.046755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.047019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.049403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:18.059017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.061016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:18.081202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:18.082181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:18.083090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:18.083090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:18.083090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:18.085040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 433/865] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:18.088283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:18.161970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310dca-8489-4ed8-960a-6024cc1931f2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.189465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5644-310f-4550-b44f-39e669842985 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.200549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.201653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.202199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.202679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.203499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:18.203995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.205919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.212651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:18.212900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 433/866] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:18.231010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.231899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.232347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.232756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.233607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:18.234047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.235654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.254989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 434/867] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:18.256808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:18.300923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:18.377284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2d98-fdb9-4801-be97-95573518de8a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.412863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.413940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.414433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.414909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.422217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.423895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:18.435639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:18.436576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:18.437585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:18.443774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 434/868] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:18.445945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:18.554038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c045e-5114-4a85-bfc8-1668478d0785 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.590980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.591581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.591852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.592117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.592795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:18.593123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.594541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d6f-b83c-4287-9b4c-cb01da9ce3f0 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.611824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 435/869] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:18.613213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:18.715210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:18.722701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cd2d-987c-4fd2-b7f1-bc97f701166e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:18.749985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d125-1c1c-48b5-b511-3995dcb29285 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.750539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d125-1c1c-48b5-b511-3995dcb29285 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.750751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d125-1c1c-48b5-b511-3995dcb29285 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.752405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 436/870] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:18.757286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.757677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.758051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.760029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:18.760830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:18.761385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:18.761964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:18.762942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=6e6a60e442924d9e92910b778414a60e) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:18.763481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:18.765163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:18.771997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 435/871] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:18 2022] GET /identity/v3/role_assignments?user.id=6e6a60e442924d9e92910b778414a60e&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:18.781247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:18.781247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:18.820618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:18.857784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 437/872] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:19.124758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.227552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f619b1-cee7-4c55-bd65-e237854f053a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.261165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:19.261800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.262076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.262345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.272787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-42c5a57b-7dc6-403a-a221-6260dd23bf38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:19.277978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:19.278937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:19.279780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 436/873] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:19.287104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.390771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c10fb-244f-49b9-affc-3fd1e734a6b8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.425474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:19.426436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.426946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.427560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.428512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:19.429060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:19.430636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:19.439634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 438/874] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:19.444242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62917f-c8bf-423c-9209-d0986f87fc94 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.444242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62917f-c8bf-423c-9209-d0986f87fc94 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.444242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62917f-c8bf-423c-9209-d0986f87fc94 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.444242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 437/875] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:19.445624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.447617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.447895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.448172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.467108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:19.468304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:19.498668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:19.502344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:19.564607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765359-5628-4aca-8d77-491c52c6be36 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.566085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 438/876] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:19.596255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:19.596889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.597203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.597478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.608153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:19.609656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:19.623732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:19.625544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:19.628242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:19.628242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:19.628242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:19.631731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 439/877] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:19.631924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.733202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd624-21fb-4202-a55e-69aa4496c37d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.767690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:19.768303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.768581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.768851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.769549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:19.769853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:19.771301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:19.783548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 439/878] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:19.789155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.864930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:19.885313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:19.887341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:19.908761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55117d5-69b0-4cf9-96a9-73969103fe1f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.952105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:19.953171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:19.953797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:19.954265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:19.963272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:19.964993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:19.981534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:19.983350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:19.984859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:19.987419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 440/879] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:19.987806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575f7ba-dd84-4d60-be8a-751e3ec375f8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:19.995022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:20.029275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.029907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.030190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.030464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.031419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.032982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa5be0-b539-4718-8bb3-9190335275d3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.061044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 440/880] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:19 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:37:20.114215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777008-0288-4b11-a7a8-a969b4969176 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:20.157805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.158425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.158704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.158973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.159700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:20.160001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.161583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.176649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26ef29-55c7-4fd9-990a-90b90b58be73 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.177235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26ef29-55c7-4fd9-990a-90b90b58be73 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.177313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26ef29-55c7-4fd9-990a-90b90b58be73 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.178053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:20.179099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 441/881] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:20.182092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 441/882] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:20.184521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.184802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.185104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.194126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:20.205925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:20.207124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:20.282338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:20.291029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 442/883] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:20.320217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64230458-e438-426f-a3ce-fe0daf23c04b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:20.355051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.355818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.356186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.356554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.421774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:20.425971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.428304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.544796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 442/884] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:20 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:20.550360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:20.568487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:20.668558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe79cf-0d34-4584-ba7b-3e55b91b85fc None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:20.690165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:20.695602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156dc90-482d-4874-b75d-9857dd7034be None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:20.713503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.714218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.714500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.714767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.728092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.729766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.734786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.735634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.736132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.736606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.737569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.739238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46093cb-589d-4239-a66c-41f4bd7619d6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-00f0153e-4a85-48a6-8e30-bbd4b2ae0555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:20.746047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:20.747057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:20.747965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:20.747965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:20.747965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:20.749047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 443/885] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:20.753458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771047c-7693-4ce1-a55a-bd856cd4279f None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.753740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771047c-7693-4ce1-a55a-bd856cd4279f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.754017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771047c-7693-4ce1-a55a-bd856cd4279f None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.759678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 444/886] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:20.760442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771047c-7693-4ce1-a55a-bd856cd4279f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:20.762601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 443/887] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:20 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:37:20.763936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.764997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.764997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.790803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:20.792311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:20.831660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:20.897159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 444/888] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:20.901037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771047c-7693-4ce1-a55a-bd856cd4279f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:20.939031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:20.939649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:20.939929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:20.940199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:20.940849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:20.941178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:20.942549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:20.956229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 445/889] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:20.961862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.049718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:21.067257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a650e-29ac-4c28-8b04-733a97e109f5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.103810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.104365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.104644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.104917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.111791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.113344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:21.125233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:21.127239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:21.129298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 445/890] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:21.136760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.190551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.238037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366366-4d11-4330-8c9a-f177e1bd0d2b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.247623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:21.274574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.275266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.275609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.275943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.276763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:21.277187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.278709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.291948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 446/891] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:21.298001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.303708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031b1d0-a881-4d68-ac82-59a32b660e50 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.342928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.343553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.343827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.344096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.344675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.346496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:21.357768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:21.358759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:21.359643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:21.364296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 446/892] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:21.366257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.385892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:21.426290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a4cff-3c46-4ccd-9e2a-61f8444187c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.471544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.473089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.473591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.474366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.475639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] RBAC: Adding query filter params (role.id=b1f7388768a44fba9f51e3757b66a02d, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=d5525e62e4114ce588a9e0649835442a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:21.476642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.478899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.485780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364d58-9b47-4544-871d-1640686fd97c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.492512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 447/893] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:21 2022] GET /identity/v3/role_assignments?user.id=d5525e62e4114ce588a9e0649835442a&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=b1f7388768a44fba9f51e3757b66a02d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:21.532566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.533214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.533513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.533793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.534376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:21.534671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.536051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1a840-768c-4c37-a61b-de5e0388194d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.546313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 447/894] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:21.547928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:21.584179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:21.657611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a612-23ec-442a-9ae7-08df011e25f1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:21.692424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:21.693284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:21.693603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:21.693875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:21.694505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:21.694803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:21.696170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c2697-d4b7-4861-bdc1-b84f65fbe283 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:21.705101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 448/895] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:22.156545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94d3e-9cca-491d-8ccb-cbc3707e8929 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.157108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94d3e-9cca-491d-8ccb-cbc3707e8929 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.157108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94d3e-9cca-491d-8ccb-cbc3707e8929 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.158700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 448/896] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:22.164289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3cc6-c025-4b5c-93c7-33d825ec7057 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.164579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3cc6-c025-4b5c-93c7-33d825ec7057 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.164857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3cc6-c025-4b5c-93c7-33d825ec7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.183327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-302b3cc6-c025-4b5c-93c7-33d825ec7057 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:22.184522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-302b3cc6-c025-4b5c-93c7-33d825ec7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:22.253640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 449/897] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:22.532588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94d3e-9cca-491d-8ccb-cbc3707e8929 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:22.612536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:22.640775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94d3e-9cca-491d-8ccb-cbc3707e8929 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:22.675816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:22.676926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.677594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.678280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.679090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:22.679740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5d52-8e69-4f62-a3b1-a5abf046443c None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.680025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5d52-8e69-4f62-a3b1-a5abf046443c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.680295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5d52-8e69-4f62-a3b1-a5abf046443c None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.681309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:22.681941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 450/898] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:22.686920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.687198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.687472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:22.692521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:22.693635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:22.694512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:22.697034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 449/899] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:22.707308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:22.708668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:22.709949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:22.731949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:22.801071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 451/900] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:22.828583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e73cd-c202-41e2-9528-bfede4d6ecbc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:22.863347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:22.864322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:22.864878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:22.865371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:22.866188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:22.866682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:22.868256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:22.873789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 450/901] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:22.879790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:22.987096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af26bc-2bcf-4ac5-8da5-526a3fcb87fb None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.022760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.023795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.024273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.024739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.025594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:23.026108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.027729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.033460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 452/902] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:23.042286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.046497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.106566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.129000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.151855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453276d-3be9-47c5-8fa4-8b8155299664 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.188443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.189101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.189355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.189625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.190315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] RBAC: Adding query filter params (interface=public, service_id=b3e990a9b40c484e99d9594fc6df44bd, region_id=RegionOne) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:23.190613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.192092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.197939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 451/903] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/endpoints?service_id=b3e990a9b40c484e99d9594fc6df44bd&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:23.203694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.217282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb0e8-5e21-417a-91de-d364f78b91a9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.253255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.254268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.255217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.255703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.256487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.258113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:23.267636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:23.268578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:23.269820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:23.277049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.277335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 453/904] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:23.278418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.311243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64541b-a0f2-4df0-ab11-027777301cbd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.348725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.349400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.349670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.349975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.350622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.352041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.364989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 452/905] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:37:23.378437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.398308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc1306-a0ce-482c-b143-8e7b7c5898c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.437345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.438367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.438845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.439333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.440212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:23.440715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.442355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fef96f-5918-4083-96cf-f59429cbf53e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.448655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 454/906] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:23.454812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.468726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c005d1-1a21-4e60-8384-c57618451134 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.469380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c005d1-1a21-4e60-8384-c57618451134 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.469851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c005d1-1a21-4e60-8384-c57618451134 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.471684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 455/907] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:23.477474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.478061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.478527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.509788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:23.511415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:23.576998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6fd0d-2235-4064-8fc8-8d38ddea5f31 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.590289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 456/908] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:23.610524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.618251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.618842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.619119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.619389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.620015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:23.620309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.621743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588eb3e-4aca-492b-8053-f14668ce62cf None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.627197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 453/909] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:23.634104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.654959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7426f7-ea10-41f6-bcbc-51d37401de04 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.655239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7426f7-ea10-41f6-bcbc-51d37401de04 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.655511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7426f7-ea10-41f6-bcbc-51d37401de04 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.658172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 454/910] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:23.662234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.662605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.662885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.682611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:23.683892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:23.728595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:23.751481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d6f82-aa0a-4730-85fa-3526a363baa2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.757060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 455/911] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:23.787562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.788444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.788920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.789401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.790294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] RBAC: Adding query filter params (interface=public, service_id=d1a746759b5346cab5ec328fb27f41f9, region_id=RegionOne) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:23.790760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.792397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.798071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 457/912] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/endpoints?service_id=d1a746759b5346cab5ec328fb27f41f9&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:23.806039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.857465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:23.916854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab304-d4ed-43ef-80fa-5b6b1c7d0984 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.953300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:23.954145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:23.954257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:23.954537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:23.955459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:23.956846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:23.961086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680440b7-30c4-427a-878a-704b87aedcdc None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:23.968996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 456/913] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:37:23.968996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.007707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.008368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.008650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.008924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.021263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:24.026555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:24.027572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:24.028440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 458/914] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:24.033733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.035580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.039480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.154385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342221ec-45e2-4fff-a815-cb984d0ed35f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.162465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d7559-b933-4a8c-9a7b-8abbc7704361 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.200257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.201705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.202186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.202692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.203536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.203844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.204510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.204787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.205080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.206055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:24.206353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.206720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.207699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.221048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 459/915] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:24.225585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.229043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 457/916] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:24 2022] POST /identity/v3/services => generated 241 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:24.305436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.346801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f322-9734-48e0-a064-4539a0283cd9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.390928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.391983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.392481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.393023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.404415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.406275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:24.421727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:24.422736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:24.423670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:24.423670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:24.423670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:24.426244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 460/917] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:24.431849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.490940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.547368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48148-ea7d-4551-a25e-f09727ea21bb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.581948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.582556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.582828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.583097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.583863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:24.584161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.585591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.602497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 458/918] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:24.603844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.722497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bd241-21e9-445b-a10a-070d3fe629fa None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.735569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.757697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.758256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.758534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.758804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.766790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.768254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:24.779957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:24.780896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:24.782590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 461/919] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:24.787332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:24.890452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb6e73-00c3-4005-afd9-17d3d69c0b69 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:24.900816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:24.928409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:24.929404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:24.929864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:24.930341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:24.931245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:24.931759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:24.934374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:24.953182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 459/920] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:24.959596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.063777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c563-c022-4271-8d89-581f21231c35 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.099065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.100015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.100475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.100924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.112166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.114077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:25.130623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:25.131665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:25.132574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:25.132574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:25.132574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:25.134458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 462/921] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:25.140502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.242399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ca4c-60c5-4421-bc8f-32d67af934de None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.276174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.276780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.277085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.277736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.278366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:25.278660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.280021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b26f2-cf90-4527-9b17-5ab4178f4ffb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.292158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 460/922] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:25.297929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.325282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:25.350130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30156b1-2a8c-46c0-a305-e30308ecb3eb None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.350469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30156b1-2a8c-46c0-a305-e30308ecb3eb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.350669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30156b1-2a8c-46c0-a305-e30308ecb3eb None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.352554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 461/923] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:25.357387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.357666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.357937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.376538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:25.378088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:25.405366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:25.409577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bbef-40ec-4dc5-aff8-3132c2ea3ce3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.445027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.445775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.446165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.446494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.453623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.455467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:25.468272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:25.469296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:25.470193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:25.471153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 462/924] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:25.473708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 463/925] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:25.479956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.584339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3da76a-3297-4363-a4c7-cc00b6da452b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.619330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.619940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.620214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.620483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.621204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:25.621505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.622939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.635457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 463/926] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:25.641412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.729899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:25.738553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.748727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e029cc-c330-4ac4-8ea7-9d1f9ef4ea2e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.758166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:25.797115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.797772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.798054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.798326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/d5525e62e4114ce588a9e0649835442a/roles/b1f7388768a44fba9f51e3757b66a02d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.801286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=d5525e62e4114ce588a9e0649835442a, role_id=b1f7388768a44fba9f51e3757b66a02d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.803372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.822750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 464/927] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:25 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/d5525e62e4114ce588a9e0649835442a/roles/b1f7388768a44fba9f51e3757b66a02d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:37:25.856296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094c71-0927-48dd-8a3f-62be6fe20ff8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:25.895598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:25.896339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.896618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.896890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.897503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:25.898896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-b25e2271-c863-4ba3-86cf-f1e19c224fad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:25.908993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:25.911746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:25.913821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 464/928] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:25.921013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:25.989154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570d7e-eb4a-4b75-8c2d-dd86bc929d5f None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.989496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570d7e-eb4a-4b75-8c2d-dd86bc929d5f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.989743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570d7e-eb4a-4b75-8c2d-dd86bc929d5f None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:25.991211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 465/929] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:25.996900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:25.997296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:25.997456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.030068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:26.030432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ac003-fb7f-460d-9f53-9efc3af0eb57 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.031252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:26.070192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.070807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.071082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.071359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.072046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:26.072355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.074292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.081000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 465/930] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:26.087082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.100745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.136545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 466/931] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:26.204072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7c5ef-9d19-4d69-a388-720bef4846a8 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.243097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.244083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.244606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.245128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.246001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:26.246493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.248045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecfadd-330f-4b9c-88ba-fd8236da95a7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.253843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 466/932] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:26.260033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.285365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.337520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a61a0-ad9f-4a4d-8acf-a10b1b0610b6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.338042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a61a0-ad9f-4a4d-8acf-a10b1b0610b6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.338042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a61a0-ad9f-4a4d-8acf-a10b1b0610b6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.339661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 467/933] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:26.344777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.345060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.345309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.365881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:26.367608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631be3-ecd9-4c3d-8020-d08a1e11ae77 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.367908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:26.404148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.405182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.405741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.406216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.407175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.408729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.432090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 467/934] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:26.433288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.441866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.449582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 468/935] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:26.514407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.554481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383f8a-98d1-4bb5-b87e-0a82022be85b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.592988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.594221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.594221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.594221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.594728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.596143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:26.605387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:26.606337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.607243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 468/936] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:26.612575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.721373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.724587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24af03-b654-473f-95b3-52e76aeefa50 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.759374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.760145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.760476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.760750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.761722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:26.762032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.763694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.769861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 469/937] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:26.775510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.847767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321fe5-d0b7-42c8-b5d4-afe4ae0aae67 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.848556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.881269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:26.890010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.891156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.891629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.892105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.893310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.896029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.900794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506073-15e7-4b82-84b4-5d5ce90c2fde None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:26.907263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:26.908501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:26.909503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 469/938] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:26.916217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:26.950897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:26.951528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:26.951804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:26.952084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:26.952719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:26.953051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:26.954479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:26.961021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 470/939] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:26.966499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:27.029987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ac21-ccf3-487b-bd9d-1218123338fe None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:27.069355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f5beb-bab0-4dc2-ba13-4440b846024d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:27.072810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:27.073464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.073746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.074018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.074650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:27.074952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:27.076321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:27.085113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 470/940] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:27.088746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:27.106807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:27.118629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:27.119889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.120380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.121252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.122470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:27.124324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:27.153546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 471/941] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:37:27.160332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:27.213948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c365-0c01-4929-8786-88eaf9f1eaf2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:27.261452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:27.262236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.262445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.262774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.263452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:27.263752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:27.265190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:27.271433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 471/942] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:27.277434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:27.385575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb41a55-be62-4221-ad40-104b449f68d4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:27.430426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:27.431444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.431928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.432409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.433349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] RBAC: Adding query filter params (interface=public, service_id=b18dab7b746940c7aebdcf109db8489c, region_id=RegionOne) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:27.433865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:27.435435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3812-7f46-4c2c-a8d7-e6f63784083d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:27.441429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 472/943] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:27 2022] GET /identity/v3/endpoints?service_id=b18dab7b746940c7aebdcf109db8489c&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:27.447372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:27.554340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c2d19-94ff-439a-9b26-e46f4aac63b3 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:27.572560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:27.590851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:27.591461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.591737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.592001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.592593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:27.593985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1451d96-8563-4772-9a72-34c73703a05f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:27.600444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 472/944] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:27 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:37:27.783284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02915-8163-412b-bb35-088db492556c None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.783475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02915-8163-412b-bb35-088db492556c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.783743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02915-8163-412b-bb35-088db492556c None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.785436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 473/945] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:27.790716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:27.790997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:27.791263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:27.809831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:27.811342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:27.881712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 473/946] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:28.149562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02915-8163-412b-bb35-088db492556c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.198791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:28.257469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02915-8163-412b-bb35-088db492556c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:28.291541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:28.292171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.292446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.292717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.303449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-34c4a268-2a44-4584-85ae-5e6e03911644 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:28.308214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:28.309442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:28.310700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 474/947] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:28.315609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.419565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93259-6b1f-4f8d-858a-a5395356c25a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:28.433384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:28.456885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:28.457826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.458327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.458928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.459770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:28.460252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:28.461828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:28.470807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 474/948] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:28.476790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef8e7-e1c5-4a9e-8f5c-6df440571579 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.476790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef8e7-e1c5-4a9e-8f5c-6df440571579 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.476790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef8e7-e1c5-4a9e-8f5c-6df440571579 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.477444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.477713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 475/949] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:28.482548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcf34-735e-471b-a968-808d81a13771 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.482833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcf34-735e-471b-a968-808d81a13771 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.483109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcf34-735e-471b-a968-808d81a13771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.512554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-570fcf34-735e-471b-a968-808d81a13771 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:28.513781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-570fcf34-735e-471b-a968-808d81a13771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:28.595312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 476/950] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:28.605036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea828-48c8-4f58-9fc0-d16444f5e434 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:28.637976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:28.638667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.638944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.639211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.651613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:28.653183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:28.668877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:28.669955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:28.670874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:28.670874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:28.670874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:28.670874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 475/951] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:28.677587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fcf34-735e-471b-a968-808d81a13771 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.721917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:28.791465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fcf34-735e-471b-a968-808d81a13771 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:28.827136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:28.827747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:28.828030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:28.828314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:28.828961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:28.829292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:28.831038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:28.843346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 477/952] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:28.849193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.863712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:28.882781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:28.966283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c39cd-f5b7-42df-bb35-06321d1180e6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:28.969107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:28.977392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eac6e-9cc3-418b-a4dd-0b6ee266b2d1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.006051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.007115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.007596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.008152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.013945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.014578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.014842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.015115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.015767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.017232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.018699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.019837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING keystone.server.flask.common [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 11:37:29.020600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:29.033378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:29.034418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:37:29.035429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:29.038035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 476/953] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:37:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:29.040542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.sql.core [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:37:29.040542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 11:37:29.040542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [parameters: {'id': '67fd556dba8b4d8489497fe987f78fda', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 11:37:29.040542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:37:29.043683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67fd556dba8b4d8489497fe987f78fda.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67fd556dba8b4d8489497fe987f78fda. Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:37:29.049981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 11:37:29.050802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application yield resource Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise self.value Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application session.commit() Aug 30 11:37:29.052387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:37:29.053873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:37:29.054904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:37:29.055709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [parameters: {'id': '67fd556dba8b4d8489497fe987f78fda', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.058371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:29.060362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67fd556dba8b4d8489497fe987f78fda. Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 478/954] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Aug 30 11:37:28 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:29.063732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.168146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.185124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b89a-0b4c-46e3-9984-bf74fcc659ee None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.188573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a3a5-37c0-4aa4-b04f-16866ca1229b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.228449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.229115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.229489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.229764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.231215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.231835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.232116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.232388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.233152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:29.233455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.234885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a1ee2-5563-4a29-bed9-35e667d1af6b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.237142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.239903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:29.252230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:29.257802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:29.258902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.259465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 477/955] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:29.259465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f91bf-c467-4396-bdfd-b1af6448bf3d None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.259465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f91bf-c467-4396-bdfd-b1af6448bf3d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.259465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f91bf-c467-4396-bdfd-b1af6448bf3d None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.259465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 478/956] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:29.259937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 479/957] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:29.260089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f91bf-c467-4396-bdfd-b1af6448bf3d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.261437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.277980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.370248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a3f64-5a04-4e7b-81cd-94b3f7680c0d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.374607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f91bf-c467-4396-bdfd-b1af6448bf3d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.405704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.406367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.406602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.406874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.410153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.410763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.411039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.411380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.412101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:29.412396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.413865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec236-e4cd-43c6-a581-d259cc55ff16 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.441010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 479/958] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:29.441010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5fc-6ce0-4ee8-b820-d1148c237f3a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.441010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5fc-6ce0-4ee8-b820-d1148c237f3a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.441010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5fc-6ce0-4ee8-b820-d1148c237f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.461395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.464547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e58ac5fc-6ce0-4ee8-b820-d1148c237f3a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:29.465842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e58ac5fc-6ce0-4ee8-b820-d1148c237f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:29.494943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.496994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.514231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.546920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 480/959] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:29.549004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a0df-2e8c-4a96-afda-6a13def3fab9 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.549457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a0df-2e8c-4a96-afda-6a13def3fab9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.550099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a0df-2e8c-4a96-afda-6a13def3fab9 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.552753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 481/960] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:29.558399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.558931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.559351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.581951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:29.583471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:29.622324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 480/961] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:29.627853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.668219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 482/962] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:29.744766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779ff9-fde1-4b2d-8595-dd9581974e51 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.761144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.785899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.786900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.787362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.787784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.798701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.800328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.815655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:29.816226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:29.817393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:29.818664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:29.818664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:29.818664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:29.820082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 481/963] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:29.825925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.925849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11104-c226-4094-bcd8-f9fccf748c6f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.941402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:29.954257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b758f-7d5b-4f40-9ad1-a605c3cd5682 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:29.964406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.965265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.965602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.965977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] PATH_INFO: `/v3/services/compute` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:29.966582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:29.968220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:29.977929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:29.979191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:29.980268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:29.981225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 483/964] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:29.981768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:29.997573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:29.998753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:29.999430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:29.999851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.000807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.001600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.003118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.026479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 482/965] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.027243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.053663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.090843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250d5e9-d05c-4138-8ba3-6d960bb90c6d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.117809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.127175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.127866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.128163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.128407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.129052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.130402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.138132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bff4d4-d424-4967-97af-20aca3d557f3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:30.139550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:30.140756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:30.141645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 484/966] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:30.142452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.181193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.181807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.182084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.182357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.182990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.183291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.185054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.189840 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 483/967] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.190567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.254206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9056-4d95-4803-a041-de9c4e03fd25 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.278801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.292598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0aa0-de81-4b50-aae2-2b100680c7ef None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.293535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.294356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.294782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.295231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.302519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.304183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:30.315445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:30.316512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 485/968] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:30.318149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.334818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.335577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.335952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.336327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.337108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.337509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.338963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.348704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 484/969] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.348704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.380081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.445649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55d794-f09f-4119-8196-b30ed78dbaf8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.457774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621726-582f-4db0-93ee-e470ed94c4ce None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.483333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.484307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.484740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.485040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.485667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] RBAC: Adding query filter params (type=compute) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.485972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.487339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.501007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 486/970] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.501007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.506566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.507191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.507387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.507658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.508371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.508675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.510309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.529279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 485/971] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.530391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.549337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.638709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f0ab-0c59-4494-b4ef-958c6db7528b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.646382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b0a0-71e2-40d2-b9f1-a87a2eac4779 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.662999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:30.689772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.690385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.690663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.690939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.691567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.691873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.694375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.696158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.696766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.697076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.697346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.698134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] RBAC: Adding query filter params (role.id=b1f7388768a44fba9f51e3757b66a02d, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=d5525e62e4114ce588a9e0649835442a) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:30.698435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.699877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de624e-f64d-497e-b41e-508ae7bf59b2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.708990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 487/972] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.711038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:30.714267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 486/973] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:30 2022] GET /identity/v3/role_assignments?user.id=d5525e62e4114ce588a9e0649835442a&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=b1f7388768a44fba9f51e3757b66a02d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:30.827106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51fc8b-d5e7-47c7-a928-8c0be8935132 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:30.865054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:30.865672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:30.865949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:30.866220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:30.866883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:30.868259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a863-c65f-406e-8123-d6b075796cb1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:30.889864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 488/974] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:31.512654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8251e-5fac-4711-9fab-52e9c86dadae None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:31.513210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8251e-5fac-4711-9fab-52e9c86dadae None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:31.513210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8251e-5fac-4711-9fab-52e9c86dadae None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:31.514833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 487/975] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:31.520002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:31.520421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:31.520664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:31.538847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:31.540025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:31.569716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:31.621350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 489/976] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:31.886891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8251e-5fac-4711-9fab-52e9c86dadae None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:31.970579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:31.997585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8251e-5fac-4711-9fab-52e9c86dadae None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:32.033280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:32.033877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.034155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.034426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.035070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:32.036689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:32.056145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.sql.core [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:37:32.056145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 11:37:32.056145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [parameters: {'user_id': 'dd5d2dba53964db597cb3cb2eb931917', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 11:37:32.056145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:37:32.063644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:37:32.064495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application yield resource Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise self.value Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application session.commit() Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:37:32.065493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:37:32.066393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:37:32.067277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application result.read() Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:37:32.068225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dd5d2dba53964db597cb3cb2eb931917', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:32.070265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 11:37:32.071275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:32.072395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 488/977] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 11:37:31 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:32.080993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:32.179989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ae8b-0536-4340-97bc-904bffa6d2da None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:32.217046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:32.217680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.217955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.218222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.226335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:32.227920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-043e1091-4523-4bbb-90b6-6e9374d97ccd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:32.240680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:32.242580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:32.244616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 490/978] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:32.248018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:32.361052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ff15-3969-40bd-9975-b0a7808ad29e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:32.397449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:32.398065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.398394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.398673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.399428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:32.399740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:32.401465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1d11-a09d-408b-b40d-41cbcb9f5c77 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:32.419175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:32.442666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 489/979] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 11:37:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:32.487814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2afa7-009a-4095-98c0-70cd7135b2ba None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.487814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2afa7-009a-4095-98c0-70cd7135b2ba None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.487814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2afa7-009a-4095-98c0-70cd7135b2ba None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.488676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 491/980] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:32.495730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f0cb-bb6f-468b-8e17-ea0631e82722 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.496052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f0cb-bb6f-468b-8e17-ea0631e82722 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.496284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f0cb-bb6f-468b-8e17-ea0631e82722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.519464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8c45f0cb-bb6f-468b-8e17-ea0631e82722 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:32.521367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8c45f0cb-bb6f-468b-8e17-ea0631e82722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:32.597354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 490/981] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:32.808647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710ba8-4635-41eb-b130-b51eef20c777 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.809206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710ba8-4635-41eb-b130-b51eef20c777 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.809427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710ba8-4635-41eb-b130-b51eef20c777 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.811161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 492/982] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:32.816263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.816505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.816800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.835300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:32.836466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:32.837734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244359b-190f-44b5-ba10-9b3751c96b6c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.837994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244359b-190f-44b5-ba10-9b3751c96b6c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.838447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244359b-190f-44b5-ba10-9b3751c96b6c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.839946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 493/983] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:32.844569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:32.844789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:32.845124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:32.863961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:32.865164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:32.882606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:32.906756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 491/984] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:32.907585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:32.945184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 494/985] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:32.974268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:33.019122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4915d-f2eb-46c3-9ee7-98ddb40d2aa6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.053605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.054196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.054485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.054752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.055394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.056766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.075401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 492/986] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:32 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:33.174344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.223905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.292842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904c8e-79d0-418c-99fd-0313eb474bb9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.341584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.342165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.342444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.342716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] PATH_INFO: `/v3/services/image` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.343288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.343472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21de6-1258-400b-9910-a66f93baaf60 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.344658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:33.354316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:33.355437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:33.358272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 495/987] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:33.361210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.363375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:33.378195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:33.390520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.391160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.391438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.391707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.392285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.393676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:33.402438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:33.403467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:33.404408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 493/988] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:33.409666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.475570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024f71-25eb-48a3-8dbe-c66eb936c026 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.515334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.515951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.516227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.516502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.517188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] RBAC: Adding query filter params (name=image) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:33.517728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.518844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.521049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e975-5941-40e9-81b5-1f2ce834fb5f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.524104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 496/989] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:33.529282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.559820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.560429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.560712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.561004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.561667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:33.562057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.563422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.569032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 494/990] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:33.574489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.613377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:33.620436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:33.644820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de4c4-b731-434d-abaa-c46345593964 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.680957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.681738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.682018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.682584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.683472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] RBAC: Adding query filter params (type=image) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:33.683772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.685082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bd3f7-0411-4d2b-8eb7-43e3e0ec054c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.685203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.690088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 497/991] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:33.723094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.723818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.724238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.724511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.725213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:33.725512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.726915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.732577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 495/992] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:33.738746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:33.850178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772226e5-a71e-4992-b5f4-5e34c7e4d739 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:33.884385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:33.884913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:33.885211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:33.885481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:33.886175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] RBAC: Adding query filter params (interface=admin, service_id=b18dab7b746940c7aebdcf109db8489c, region_id=RegionOne) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:33.886477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:33.887837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2f12-7e10-491f-b999-47046b7c9f9c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:33.896999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 498/993] 10.222.0.13 () {56 vars in 1249 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/endpoints?service_id=b18dab7b746940c7aebdcf109db8489c&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:33.899190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:34.003819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2613-ea1c-490c-9e05-b1038fe4d1f9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:34.006597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:34.043156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:34.044074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:34.044550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:34.045022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:34.045807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:34.047340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d8183-acb2-4465-a34c-b2e915a92bb9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:34.054426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 496/994] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:33 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:37:35.130941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750cd-353a-4332-bca1-869a10eab6c7 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.131473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750cd-353a-4332-bca1-869a10eab6c7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.131473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750cd-353a-4332-bca1-869a10eab6c7 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.132823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 499/995] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:35.138223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03375f7-23b2-4336-bfb5-a3a7e55acfe5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.138649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03375f7-23b2-4336-bfb5-a3a7e55acfe5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.138826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03375f7-23b2-4336-bfb5-a3a7e55acfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.158227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d03375f7-23b2-4336-bfb5-a3a7e55acfe5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:35.159450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d03375f7-23b2-4336-bfb5-a3a7e55acfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:35.230633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 497/996] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:35.493952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56750cd-353a-4332-bca1-869a10eab6c7 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:35.497854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:35.604875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56750cd-353a-4332-bca1-869a10eab6c7 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:35.605625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14959-8e22-4c70-bfff-31a6db0faaef None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.605909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14959-8e22-4c70-bfff-31a6db0faaef None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.606178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14959-8e22-4c70-bfff-31a6db0faaef None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.607506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 498/997] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:37:35.612555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.612837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.613143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.631078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:35.632290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:35.641171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:35.642165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.642445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.642723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] PATH_INFO: `/v3/services/compute` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.643607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:35.644990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:35.654358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:35.655410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:35.656369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 500/998] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:35.661350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:35.705724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 499/999] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:35.731440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:35.767088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e37f-b85b-4979-8bdf-a81e68b754de None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:35.801720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:35.802378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.802657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.802937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.803561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:35.803862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:35.805270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:35.813818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 501/1000] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:35.819501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:35.849632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:35.923189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd750a6-34e7-4bc4-93db-3112582367c5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:35.958792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:35.959406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:35.959685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:35.959955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:35.960587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:35.960889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:35.962287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:35.970942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 500/1001] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:35.971853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:35.973884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:36.067238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:36.076318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4d79-a8e4-4264-bd90-3dcc58995304 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.076489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d644-ee5f-4ffd-b264-bf63a9aa87ca None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.105550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:36.110892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.111128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.111497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.111727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.111929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.112022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.112107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.112256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.112696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] RBAC: Adding query filter params (interface=public, service_id=70bf1b248d974998be981de1c02e993e, region_id=RegionOne) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:36.112910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.113030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.114382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dfcaf-3e1a-4f5d-a500-babb2adea3c3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.114506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61c7e3-9aa1-4d2d-988a-5117e1af7286 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.124161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 501/1002] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:35 2022] GET /identity/v3/endpoints?service_id=70bf1b248d974998be981de1c02e993e&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:36.124161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd629-2c31-4c9c-8351-ddb37d4c91e2 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.124161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd629-2c31-4c9c-8351-ddb37d4c91e2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.124161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd629-2c31-4c9c-8351-ddb37d4c91e2 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.124161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 502/1003] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:36.125117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd629-2c31-4c9c-8351-ddb37d4c91e2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:36.137506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 502/1004] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:35 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:36.137506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.137506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.137506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.158224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:36.159482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:36.249310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 503/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:36.250333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd629-2c31-4c9c-8351-ddb37d4c91e2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.291111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.291720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.291994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.292256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.292857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.294234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.302328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 503/1006] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:36 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:37:36.515169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:36.618306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e5f35-416e-44d2-aac8-c134f2ae2468 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.636027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:36.654269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.654917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.655193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.655462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.656045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.657451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:36.666322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:36.667323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:36.668177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 504/1007] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 11:37:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:36.675589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:36.695436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:36.785737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f23d74-7ec2-44a1-92ef-9e338bd893fd None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.819913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.820522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.820804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.821103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.821731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:36.822033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.823389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.828375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 504/1008] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:36.834391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:36.937820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d39b2-ebdb-49b5-ac3e-503366090a7a None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:36.972911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:36.973628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:36.973987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:36.974259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:36.975038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:36.975436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:36.976849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595695c5-1bf8-4c43-98e0-01b62b544687 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:36.981878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 505/1009] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 11:37:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:36.987577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:37.072539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:37.093057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a200-a78b-4ba1-a1d4-4f0b0a54532e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:37.127986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:37.128594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:37.128866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:37.129168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:37.129851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:37.131254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a28e-17d6-4b90-b1ab-438bc984456b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:37.156954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 505/1010] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:38.052052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a39b-e409-4615-a7e9-08a31adbd617 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.052598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a39b-e409-4615-a7e9-08a31adbd617 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.052758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a39b-e409-4615-a7e9-08a31adbd617 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.054233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 506/1011] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:38.059566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a6b4-5ebe-49a9-a254-bb1f4d7a1a22 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.059986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a6b4-5ebe-49a9-a254-bb1f4d7a1a22 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.060088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a6b4-5ebe-49a9-a254-bb1f4d7a1a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.078445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6c54a6b4-5ebe-49a9-a254-bb1f4d7a1a22 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:38.079613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6c54a6b4-5ebe-49a9-a254-bb1f4d7a1a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:38.157666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 506/1012] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:38.193293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f16f-831a-4c66-8114-3587d84a0148 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.193533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f16f-831a-4c66-8114-3587d84a0148 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.193829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f16f-831a-4c66-8114-3587d84a0148 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.195320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 507/1013] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:38.200364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.200656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.200889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.220170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:38.221411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:38.284175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:38.293900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 507/1014] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:38.419760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f16f-831a-4c66-8114-3587d84a0148 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.469332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:38.531615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f16f-831a-4c66-8114-3587d84a0148 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:38.559745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.565987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:38.566625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.566904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.567179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.567758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:38.569196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:38.578898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:38.579948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:38.581154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 508/1015] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:38.586633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.672568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f012fb-318e-4e83-9673-6468a49f043b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:38.697302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549dc7b-4b80-447e-bb40-6b3d31eb94d9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:38.707520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:38.708362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.708861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.708997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.709527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:38.710896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:38.711274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:38.720661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:38.721928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:38.723660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 508/1016] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:38.728168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.740617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:38.741269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.741553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.741823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.742463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] RBAC: Adding query filter params (name=image) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:38.742762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:38.744128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:38.749034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 509/1017] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:38.754978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.795116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:38.840611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395bdec-bf9e-4f6e-8885-b8062c732671 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:38.863492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c017bc-49e0-463c-8859-956a18045524 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:38.874913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:38.875521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.875800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.876066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.876690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:38.877008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:38.878413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:38.888019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 509/1018] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:38.889178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.904009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:38.904999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:38.904999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:38.905280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:38.906026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] RBAC: Adding query filter params (type=image) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:38.906320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:38.907694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:38.914117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 510/1019] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:38.919858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:38.964653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:39.000875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bac3-6914-4fc2-8735-60f1e9f2e27f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.026105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:39.031611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c8f35-b810-4d17-a730-05bbee1bbefa None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.038660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.039593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.039593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.039883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.040439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] RBAC: Adding query filter params (type=compute) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:39.040747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.042148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.052211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 510/1020] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:39.053282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:39.066386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.066991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.067281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.067750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.068248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] RBAC: Adding query filter params (interface=public, service_id=cc7e214e7a214a6282c838540028adf7, region_id=RegionOne) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:39.068552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.069963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae128cae-b1b6-4122-b90f-039637f8b665 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.074937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 511/1021] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:37:38 2022] GET /identity/v3/endpoints?service_id=cc7e214e7a214a6282c838540028adf7&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:39.076156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691deefd-97ba-4911-843f-115642e6cf6b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.076519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691deefd-97ba-4911-843f-115642e6cf6b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.076857 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691deefd-97ba-4911-843f-115642e6cf6b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.081003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 512/1022] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:39.081003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691deefd-97ba-4911-843f-115642e6cf6b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:39.156666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23544c5d-df5e-40d0-8f9f-41d7e481c91b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.188685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691deefd-97ba-4911-843f-115642e6cf6b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.190243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:39.192072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.193343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.193651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.193899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.194568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.195941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f879e-9dde-4825-9b6d-8b995959f238 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.216759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 511/1023] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:39.217929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.218211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.218482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.233984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.234617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.234890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.235205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.235818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.237348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.245345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 513/1024] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:37:39 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:37:39.252226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:39.253621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:39.303628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:39.340464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 512/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:39.606093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:39.707586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ee57-5109-4878-a3e9-7df59959e2c4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.743014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.743607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.743894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.744169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.745311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.746780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670be203-d659-49f5-970c-5dd9e774a0a3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.748519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 514/1026] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:39.754224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:39.857944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94755-98a9-4e04-8fcb-965563b7272f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:39.893471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:39.894079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:39.894354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:39.894620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:39.895274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:39.896845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54914485-930f-4655-bd0e-e2c1591ec6fb None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:39.923677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 513/1027] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:37:39 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:41.187794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49958f0-b2f9-49c1-8260-e919a30863ae None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.188319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49958f0-b2f9-49c1-8260-e919a30863ae None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.188319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49958f0-b2f9-49c1-8260-e919a30863ae None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.189818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 515/1028] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:41.195367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.195784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.195952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.215614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:41.216802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:41.223439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75682-5593-4b0f-b33b-070acd14ac93 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.223957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75682-5593-4b0f-b33b-070acd14ac93 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.224352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75682-5593-4b0f-b33b-070acd14ac93 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.225738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 516/1029] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:41.230653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.230897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.231170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.238405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:41.250435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:41.251624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:41.275222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:41.294402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 514/1030] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:41.321686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 517/1031] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:41.562725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:41.586770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:41.678868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab8b0-7e2e-4760-9d04-8ffd4f92bf47 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:41.689210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8673b-53a4-4083-a17c-fa4103cc6c89 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:41.718233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:41.718844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.719117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.719411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] PATH_INFO: `/v3/services/image` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.719986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:41.721395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:41.727415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:41.728048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.728323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.728592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:41.730399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:41.731451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:37:41.732297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:41.736569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 515/1032] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 11:37:41 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:41.737329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:41.742286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:41.747463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:41.748460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:41.750147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:41.751836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 518/1033] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:41.754737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:41.767131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:41.779090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:41.863900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab5f3-20c1-4ffa-ae6d-5fbe653180f9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:41.878134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e615-e897-4600-8a73-39d5497ee32a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:41.897915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:41.898516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.898794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.899061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.899719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:41.900096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:41.901409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ee2-e2d1-4317-9d50-fb334c48c8c5 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:41.908992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 519/1034] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:41.910182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f940e-08db-4a4f-a2b9-0c2fe2b7bbec None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.910463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f940e-08db-4a4f-a2b9-0c2fe2b7bbec None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.910733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f940e-08db-4a4f-a2b9-0c2fe2b7bbec None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.911331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:41.912005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.912113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 520/1035] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:41.912305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.913108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.913260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] RBAC: Adding query filter params (name=image) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:41.913551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:41.914826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f940e-08db-4a4f-a2b9-0c2fe2b7bbec None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:41.914950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29fa18-1015-4e07-b6eb-5938d5562c0e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:41.920240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 516/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:41.921295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:41.921587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:41.921860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:41.939917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:41.941203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:41.998701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.009200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 517/1037] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:42.009899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.023974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f940e-08db-4a4f-a2b9-0c2fe2b7bbec None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.025516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.058523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.059259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.059535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.059804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.070744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.072389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:42.087486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:42.088456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:42.089969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:42.089969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:42.089969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:42.089969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 521/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:42.094503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.117311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f9ec-317a-48c8-b943-3b5324e34dd0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.154194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.154804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.155184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.155505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.156238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:42.156577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.158088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.163870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 518/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:42.169276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.199577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac9924-0641-446d-a825-44df64396c50 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.237167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.237778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.238054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.238369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.239016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:42.239369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.240734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.242164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.254095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.257939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 522/1040] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:42.258846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.279383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f0364-fb92-4fd0-a462-a9124aff42f7 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.314427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.315043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.315323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.315592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.316256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.318455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.339970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 519/1041] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:37:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:37:42.340614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.366561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869538-9569-46b6-825c-85df4ec0d0d1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.411282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.411924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.412223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.412473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.420528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.422028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:42.434707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:42.435755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:42.436810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:42.443204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 523/1042] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:42.444202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.463256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73ef6-c682-4b99-934c-ffd880f18374 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.508093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.514889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.515465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.515744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.516040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.517230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.518795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.520461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 520/1043] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:42.526542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.530058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.566296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685175dc-e1b7-493e-ae0e-cc9fee5c5a86 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.601007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.601966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.601966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.602158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.602857 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:42.603159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.604597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.623681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 524/1044] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:42.629137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:42.637312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdf77-ea61-457e-82c4-501a92ff312f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.672665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.673653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.673653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.673851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.674478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.675968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.708999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 521/1045] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:37:42 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:37:42.743237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d5cf-8cf8-44a2-a60b-2940f0db0e2e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:42.754484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:42.783898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:42.784432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:42.784710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:42.785018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:42.862865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:42.864544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:42.969723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 525/1046] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:37:42.975765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:43.033810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:43.079089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9582dd-af73-402c-8e17-24f2d5320396 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:43.114861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:43.115492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:43.115768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:43.116036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:43.126761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:43.128204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:43.142365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:43.143349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:43.144273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:43.144273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:43.144273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:43.144273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 522/1047] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:43.150813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:43.164464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:43.258597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fadd-829f-4d99-b09c-82153830d468 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:43.292542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:43.293180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:43.293454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:43.293718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:43.294346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:43.294642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:43.296003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:43.307648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 526/1048] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:43.313272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:43.415105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5a5e9-61ef-4cf5-b728-1cd683cf07c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:43.425771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:43.452834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:43.453528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:43.453806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:43.454074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:43.461282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:43.462761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:43.474170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:43.488703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:43.491085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 523/1049] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:43.492854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:43.562485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:43.598242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8277cdb-0a98-4dda-acad-5d7336bd9e27 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:43.631830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:43.632430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:43.632709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:43.632999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:43.633668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:43.633964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:43.635442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bf853-0389-4332-b3ef-d7a4baa3f5f2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:43.647891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 527/1050] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:43.653819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:43.756745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15204494-54f8-4710-87db-2aafe41561b9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:43.791041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:43.791648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:43.791926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:43.792197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:43.792916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] RBAC: Adding query filter params (role.id=b1f7388768a44fba9f51e3757b66a02d, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:43.793250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:43.794680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cd75-2b35-4162-a3de-04eeaa9e049c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:43.800564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 524/1051] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:43 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=b1f7388768a44fba9f51e3757b66a02d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:44.251165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4b2e-1872-4d38-8049-da76369d7656 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:44.251522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4b2e-1872-4d38-8049-da76369d7656 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:44.251707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4b2e-1872-4d38-8049-da76369d7656 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:44.253110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 528/1052] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:44.258419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4e48-f7af-4135-bd8d-0e752255ef69 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:44.258667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4e48-f7af-4135-bd8d-0e752255ef69 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:44.258969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4e48-f7af-4135-bd8d-0e752255ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:44.277609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-843d4e48-f7af-4135-bd8d-0e752255ef69 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:44.278775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-843d4e48-f7af-4135-bd8d-0e752255ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:44.306457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:44.351087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 525/1053] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:44.610682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4b2e-1872-4d38-8049-da76369d7656 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:44.680394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b586bb-3196-4b74-997c-d664b4569916 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:44.680908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b586bb-3196-4b74-997c-d664b4569916 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:44.681230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b586bb-3196-4b74-997c-d664b4569916 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:44.683206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 526/1054] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:44.687973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:44.688254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:44.688527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:44.707044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:44.708263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:44.720154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4b2e-1872-4d38-8049-da76369d7656 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:44.749225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:44.759185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:44.759789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:44.760170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:44.760461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:44.781014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 527/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:44.833471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:44.834945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:44.935027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 529/1056] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:44.941138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.035894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.044292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797e255-2dcc-49a0-b68c-120e9e394f3b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.044765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.081496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.082099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.082233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.082716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.082716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.093325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:45.094770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:45.110374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:45.111385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:45.112744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:45.112744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:45.112744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:45.112744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 528/1057] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:45.117665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.172680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137929-42d9-4c9b-a493-4f068d16730e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.208267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.208809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.209115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.209385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.220032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:45.224408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c3846-2956-4e54-90b1-8911652b7f7a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:45.224822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:45.225975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:45.226832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 530/1058] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:45.231797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.264088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.264945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.265435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.265704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.266343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:45.266644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:45.268002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:45.289007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 529/1059] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:45.333094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.346953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8ae1-9c96-4e47-8ab2-94b0e777abd9 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.385116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.385736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.386012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.386280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.386954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:45.387252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:45.388639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:45.398820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 531/1060] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:45.404731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.414395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.514817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9186-f3e8-4ee4-b31e-94b59a46cbee None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.549510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.550456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.550939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.551410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] PATH_INFO: `/v3/users/9386bea331f24ae4a2f6c969bd334ea8` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.565262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] RBAC: Authorizing `identity:get_user(user_id=9386bea331f24ae4a2f6c969bd334ea8)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:45.566718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69bb66-133c-4371-afa0-5df2f08fb61f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:45.568474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 530/1061] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/users/9386bea331f24ae4a2f6c969bd334ea8 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:45.574434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.675451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403378-e051-4861-a06c-61f949f28999 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:45.676082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c65b-f101-4aac-9343-7fb07a100b67 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.676281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c65b-f101-4aac-9343-7fb07a100b67 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.676550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c65b-f101-4aac-9343-7fb07a100b67 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.678087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 531/1062] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:45.682942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.683227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.683502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.701938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:45.703111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:45.710592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:45.711201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:45.711480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:45.711751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:45.729708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.763201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:45.772252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 532/1063] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:37:45.778113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:45.779562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:45.878013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 532/1064] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:45.884354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:45.986631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d41c2-0f1a-424a-b049-f0ef77d35c8c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.023853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.024399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.024677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.024945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.026121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.027559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.029223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 533/1065] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:37:45 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:46.035746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.037629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.087720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:46.101533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:46.140010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5db29-32dc-4914-8a67-68f6fedcc17a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.140291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dca78-72f7-48bc-ba86-442eb5dccd49 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.174921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.175241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.175573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.175858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.175998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.176133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.176409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.176762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.178282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=a3cefc5298c54836814e6f99b57d889a, user.id=9386bea331f24ae4a2f6c969bd334ea8) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:46.178592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.180066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.186217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 533/1066] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/role_assignments?user.id=9386bea331f24ae4a2f6c969bd334ea8&scope.project.id=a3cefc5298c54836814e6f99b57d889a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:46.188635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:46.195642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:46.196830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:46.201971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 534/1067] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:46.204088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.311762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b86-6670-4156-bc0c-e7fafe54ee4c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.326673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:46.346844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.347446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.347719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.347986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.348722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:46.349112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.350441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.358331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 534/1068] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:46.364018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.468666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03f7f-a7f7-476c-a98e-c381704b9b28 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.493216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:46.508506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.509174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.509463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.509725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.520810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.522288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:46.536460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:46.537440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:46.538334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:46.538334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:46.538334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:46.538334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 535/1069] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:46.543584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.645625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591e02-265c-463d-ae2d-a62b54648437 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.679753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.680400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.680624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.680895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.681558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:46.681859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.683232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.694862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 535/1070] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:46.700609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.802522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b5a8-f138-4930-ae24-d8b9815207f6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:46.837442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:46.838061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:46.838339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:46.838587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:46.846136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:46.847578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:46.858831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:46.859799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:46.860751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 536/1071] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:46.866096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:46.901026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:46.965919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dd6b-7322-4158-9fc7-e311dbce320c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.002754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.003353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.003626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.003890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.004598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:47.005152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.006576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.024448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 536/1072] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:47.030292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:47.068607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:47.136053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96513f-f508-4bdf-a594-93bfee616037 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.169250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.169792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.170073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.170344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.180933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.182409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:47.196377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:47.197539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:47.198466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:47.198466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:47.198466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:47.198466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 537/1073] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:47.203523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:47.297235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:47.304639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f302-ba8f-4c08-8d90-5c2f3df09b5d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.337892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.338484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.338756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.339022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.339654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:47.339948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.341340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.352179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 537/1074] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:47.358070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:47.449543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:47.465366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48fc-6d5b-4d61-99c3-597f26cedb26 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.504027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.504670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.505091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.505575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.512374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.513861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:47.525323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:47.526230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:47.527111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 538/1075] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:47.532464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:47.636582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99948beb-7a94-47df-a3f4-e37549e738e7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.671148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.671752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.672025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.672298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.673003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:47.673307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.674736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924bffe-1bb0-416c-a78b-56005d45f616 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.687596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 538/1076] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:47.693838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:47.798777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6e630-7677-4450-8b87-0c867174503c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:47.834740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:47.835395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:47.835675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:47.835943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/b1f7388768a44fba9f51e3757b66a02d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:47.838245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=51f86708703f4f86953e188c3bac4c58, role_id=b1f7388768a44fba9f51e3757b66a02d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:47.839655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee45b3-c7c2-48f5-930e-b2332e22e775 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:47.854968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 539/1077] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:47 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/51f86708703f4f86953e188c3bac4c58/roles/b1f7388768a44fba9f51e3757b66a02d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:37:48.071809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aeaa7-7c5b-470e-a5b8-b00ba65e5c2c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:48.072002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aeaa7-7c5b-470e-a5b8-b00ba65e5c2c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:48.072257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aeaa7-7c5b-470e-a5b8-b00ba65e5c2c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:48.073602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 539/1078] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:48.079248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:48.079531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:48.079799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:48.093449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:48.099735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:48.101395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:48.172533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 540/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:48.430943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aeaa7-7c5b-470e-a5b8-b00ba65e5c2c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:48.448233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:48.544478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aeaa7-7c5b-470e-a5b8-b00ba65e5c2c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:48.577944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:48.578681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:48.579020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:48.579352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:48.589565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:48.594195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:48.595160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:48.596015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:48.600607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 540/1080] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:48.601761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:48.709045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b73b56-1311-4d88-b506-0d6c71d19008 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:48.742615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:48.743205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:48.743482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:48.743752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:48.744412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:48.744711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:48.746127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:48.748346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:48.760264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 541/1081] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:48.761571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:48.841357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:48.868587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff882be-7a2c-475d-b9d9-2c8ae0ab4a9d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:48.904570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:48.905267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:48.905537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:48.905806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] PATH_INFO: `/v3/users/9386bea331f24ae4a2f6c969bd334ea8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:48.907021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9386bea331f24ae4a2f6c969bd334ea8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:48.908469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:48.910302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 541/1082] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:37:48 2022] GET /identity/v3/users/9386bea331f24ae4a2f6c969bd334ea8 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:48.916064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:49.021225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5fd5-5894-430d-a731-a24bb06614ba None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:49.054368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:49.054994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:49.055278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:49.055559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:49.056674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:49.058146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69ed4-26e3-44d5-87c9-e3ce8a03fb0b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:49.059991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 542/1083] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:37:48 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:49.065933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:49.164078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1add-a13a-4559-8763-b6ec5689e8e4 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:49.198042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:49.198694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:49.198968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:49.199236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a/users/9386bea331f24ae4a2f6c969bd334ea8/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:49.201227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3cefc5298c54836814e6f99b57d889a, user_id=9386bea331f24ae4a2f6c969bd334ea8, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:49.202634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd65bc-7528-4cbc-9766-33271bedfed6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:49.216872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 542/1084] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:37:49 2022] PUT /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a/users/9386bea331f24ae4a2f6c969bd334ea8/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:37:49.723191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4b15-f2aa-4398-baa6-efd0649f9fd0 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:49.723854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4b15-f2aa-4398-baa6-efd0649f9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:49.723945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4b15-f2aa-4398-baa6-efd0649f9fd0 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:49.725367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 543/1085] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:49.730648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:49.730933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:49.731205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:49.737671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:49.751401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:49.752515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:49.821491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 543/1086] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:50.083284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4b15-f2aa-4398-baa6-efd0649f9fd0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.150006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:50.186964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4b15-f2aa-4398-baa6-efd0649f9fd0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:50.222916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:50.223580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:50.223858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:50.224128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:50.234990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:50.239825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:50.240803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:37:50.241713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:50.245191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 544/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:50.247114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.347545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9c545-a09e-484a-bf18-12320075b889 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:50.376892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:50.383061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:50.383666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:50.383946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:50.384217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:50.384878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:50.385203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:50.386570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:50.394371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 544/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:50.400473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.505134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352ba3-02c5-41b4-bf6b-3cc722fcfe71 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:50.531490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:50.541583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:50.542221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:50.542502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:50.542774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:50.554060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:50.555513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:50.569887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:50.570880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:50.571787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:50.571787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:50.571787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:50.571787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 545/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:50.577219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.681678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78041-1767-4446-8ee1-c1bd8b5da44c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:50.716580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:50.717185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:50.717458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:50.717725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:50.718347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:50.718643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:50.719992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:50.732112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 545/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:50.738070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.840915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddbf08-98a5-4730-a62e-084019dfef0c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:50.875152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:50.875775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:50.876052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:50.876321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:50.883947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:50.885428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-6b3eea68-7aca-470f-94e4-df07a3ebf8b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:37:50.896710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:50.897704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:50.898654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 546/1091] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:50.903813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:50.964121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.008027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0246a-df0e-4ac4-9077-360b42f43162 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.048303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.048907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.049213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.049480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.050193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:51.050493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.052587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.066063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdc9f-3485-43de-8b3f-d84d51dffc95 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.066346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdc9f-3485-43de-8b3f-d84d51dffc95 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.066616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdc9f-3485-43de-8b3f-d84d51dffc95 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.068797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 547/1092] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:51.073703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 546/1093] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 11:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:51.074013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.074300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.074572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.076194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.092862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:51.094091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:51.124875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.163012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 548/1094] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:51.178966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9e70-a11b-4a63-97c3-338f469d53ea None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.192256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.214857 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.215386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.215665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.215922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.284031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.285541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.386525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 547/1095] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:37:51.392478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.428504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.443946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.497599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7e3f-365e-4ebf-896b-fde12fccd9ed None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.531981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.532164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4572c-e9a3-4d64-9466-fc546eec58a2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.532608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.532885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.533179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.543129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.544576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:37:51.558771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:51.559913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:37:51.560803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:37:51.560803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:37:51.560803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:51.560803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 549/1096] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:51.565652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.570540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.571168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.571447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.571685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.582281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:37:51.587067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:51.588142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:37:51.589008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:37:51.589794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.589882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 548/1097] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:37:51.594095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.663071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.671126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176a50d-14c3-4e73-8c44-d6e343f7bc7f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.692568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc37d-86d9-42ca-af50-efcc28fde148 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.705078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.706004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.706279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.706548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.707185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:51.707483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.708911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.721258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 550/1098] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:51.726608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.727207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.727326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.727476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.727734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.728385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:51.728679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.730074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.738534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 549/1099] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:51.744335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.806997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.826363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ad586-9915-4b7d-affc-c71003c44476 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.843783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032548-5b32-4423-ac37-27cd49c0a664 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.860460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.861149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.861425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.861719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.868367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.869837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.877757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:51.878385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:51.878665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:51.878939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] PATH_INFO: `/v3/users/9386bea331f24ae4a2f6c969bd334ea8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:51.880153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] RBAC: Authorizing `identity:get_user(user_id=9386bea331f24ae4a2f6c969bd334ea8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:37:51.880878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:37:51.881768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:37:51.883200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:37:51.883873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:51.883959 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 551/1100] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:37:51.884041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 550/1101] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/users/9386bea331f24ae4a2f6c969bd334ea8 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:51.887796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.888794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:51.891393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:51.988123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74587-05c3-4806-83f3-8350b4722a0e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:51.988751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86f16c-b2a3-4bc2-a705-c187b4fd10c6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:52.021190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:52.021386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:52.021728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:52.021980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:52.022082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:52.022264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:52.022407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:52.022552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:52.023468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:52.023776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:52.025235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:52.034095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:52.038468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 552/1102] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:52.043977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:52.094301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:52.095763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:52.097598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:52.143729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97c15-ffdc-4a7f-8083-3ccd7f72ec2c None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:52.176792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:52.177411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:52.177685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:52.177951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:52.178664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] RBAC: Adding query filter params (role.id=b1f7388768a44fba9f51e3757b66a02d, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=51f86708703f4f86953e188c3bac4c58) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:52.178968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:52.180390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:52.185952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 553/1103] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:52 2022] GET /identity/v3/role_assignments?user.id=51f86708703f4f86953e188c3bac4c58&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=b1f7388768a44fba9f51e3757b66a02d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:52.194869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 551/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:37:52.200940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:52.267741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:52.310363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683c0b2-ca68-42f5-b53c-c8faa5b43f67 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:52.348048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:52.348934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:52.349350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:52.349516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:52.350641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:52.352093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d134da-4c77-45fa-a2d1-807d99be4d80 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:52.353768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 554/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:37:52 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:52.360279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:52.461266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f77d-aee1-4c8c-aae8-2ec0f34c68ee None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:52.462844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:52.497353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:52.497970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:52.498241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:52.498504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:52.499225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=a3cefc5298c54836814e6f99b57d889a, user.id=9386bea331f24ae4a2f6c969bd334ea8) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:52.499521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:52.500950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd504b3-08b4-4b6b-b18f-c62ff1e23a5f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:52.507684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 552/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:52 2022] GET /identity/v3/role_assignments?user.id=9386bea331f24ae4a2f6c969bd334ea8&scope.project.id=a3cefc5298c54836814e6f99b57d889a&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:54.431078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d15b-70b6-4be2-acfa-7ca2de433298 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:54.431656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d15b-70b6-4be2-acfa-7ca2de433298 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:54.431656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d15b-70b6-4be2-acfa-7ca2de433298 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:54.433735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 555/1107] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:54.442887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:54.443339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:54.443432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:54.474508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:54.475696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:54.546575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 553/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:54.821410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d15b-70b6-4be2-acfa-7ca2de433298 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:54.947932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d15b-70b6-4be2-acfa-7ca2de433298 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:54.979294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:54.985839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:54.986469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:54.986741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:54.987008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:54.988131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:54.989631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd033e2-db7c-4a1b-9519-941b5200b0e1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:54.991213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 556/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:54.997362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:55.094432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:55.100996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52d98-f302-4f23-bbfb-234dbdd9cffa None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:55.138413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:55.139006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:55.139279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:55.139538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:55.140173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:55.141641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8283563-1d2f-4b82-8e5a-98b3621d35f8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:55.167499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 554/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:37:54 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:37:57.097911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6718-4d03-45f5-8623-253e92a6a939 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:57.098463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6718-4d03-45f5-8623-253e92a6a939 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:57.098463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6718-4d03-45f5-8623-253e92a6a939 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:57.099870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 557/1111] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:37:57.106137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:57.106860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:57.107039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:57.129217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:37:57.130533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:37:57.212898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 555/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:37:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:37:57.488612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6718-4d03-45f5-8623-253e92a6a939 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:57.606972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6718-4d03-45f5-8623-253e92a6a939 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:57.644167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:57.644778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:57.645079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:57.645348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] PATH_INFO: `/v3/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:57.646842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] RBAC: Authorizing `identity:get_role(role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:57.648200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:57.649544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 558/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:37:57 2022] GET /identity/v3/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:57.658742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:57.742109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:57.762270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6330c96-4d0c-4d62-9431-e84cf602bcb0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:57.795339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:57.795954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:57.796234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:57.796499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] PATH_INFO: `/v3/users/6597e1aa811844988e7851fe5aa9f2b1` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:57.809817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] RBAC: Authorizing `identity:get_user(user_id=6597e1aa811844988e7851fe5aa9f2b1)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:57.811256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:57.812836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 556/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:37:57 2022] GET /identity/v3/users/6597e1aa811844988e7851fe5aa9f2b1 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:37:57.818940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:57.890398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:57.931352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ba2f-467a-4297-8e4c-703410f0b551 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:57.968145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:57.968756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:57.969062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:57.969339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:58.041058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:58.042513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:58.122861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:37:58.159263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 559/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:37:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:37:58.165777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:58.265675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34284fa-0315-4885-bf65-bf09bd927c6d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:58.301091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:58.301661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:58.301968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:58.302243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:58.303485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:58.304919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce47e83-6938-48ac-888b-ee69bc1a4eab None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:58.306565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 557/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:37:58 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:37:58.313638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:37:58.420465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec131c-afa9-4259-87f7-b42ef8859807 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:37:58.459424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:37:58.460021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:37:58.460292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:37:58.460558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:37:58.461309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=a3cefc5298c54836814e6f99b57d889a, user.id=6597e1aa811844988e7851fe5aa9f2b1) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:37:58.461619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:37:58.463041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aba48-7fb2-408a-8b01-13b87600bef1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:37:58.468999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 560/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:37:58 2022] GET /identity/v3/role_assignments?user.id=6597e1aa811844988e7851fe5aa9f2b1&scope.project.id=a3cefc5298c54836814e6f99b57d889a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:00.328538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6a6b-1e36-4c43-b6c5-9bfeb7984a53 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:00.329366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6a6b-1e36-4c43-b6c5-9bfeb7984a53 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:00.329528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6a6b-1e36-4c43-b6c5-9bfeb7984a53 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:00.331918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 558/1118] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:00.337168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:00.337608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:00.337710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:00.358305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:00.360097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:00.395638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:00.438024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 561/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:00.697922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a6a6b-1e36-4c43-b6c5-9bfeb7984a53 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:00.713269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:00.808657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a6a6b-1e36-4c43-b6c5-9bfeb7984a53 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:00.846237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:00.846864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:00.847142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:00.847415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] PATH_INFO: `/v3/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:00.849078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] RBAC: Authorizing `identity:get_role(role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:00.850563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:00.851877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 559/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:00 2022] GET /identity/v3/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:00.857816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:00.965716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5ab8-1ffb-41f0-a485-ec349e4816d7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:01.001957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:01.002574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:01.002859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:01.003112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] PATH_INFO: `/v3/users/6597e1aa811844988e7851fe5aa9f2b1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:01.004262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] RBAC: Authorizing `identity:get_user(user_id=6597e1aa811844988e7851fe5aa9f2b1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:01.005744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:01.007310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 562/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:00 2022] GET /identity/v3/users/6597e1aa811844988e7851fe5aa9f2b1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:01.013273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:01.092229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:01.119637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d3c9-8be7-49a8-b1df-3632977ef119 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:01.155463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:01.156085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:01.156363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:01.156645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:01.157903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:01.159359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb89e2c-dc8f-431a-9940-d29abc36e9ff None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:01.161006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 560/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:01 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:01.170773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:01.212296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:01.288412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae88065-a82a-4fbf-9a67-88d018527589 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:01.325207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:01.325863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:01.326132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:01.326397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a/users/6597e1aa811844988e7851fe5aa9f2b1/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:01.328654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3cefc5298c54836814e6f99b57d889a, user_id=6597e1aa811844988e7851fe5aa9f2b1, role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:01.330115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c2b4-ae78-432f-88f4-74fc87a03f77 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:01.346023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 563/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:38:01 2022] PUT /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a/users/6597e1aa811844988e7851fe5aa9f2b1/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:38:03.251159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0f42-f18b-4317-a44f-c87cd83908f0 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:03.252041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0f42-f18b-4317-a44f-c87cd83908f0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:03.252041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0f42-f18b-4317-a44f-c87cd83908f0 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:03.254205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 561/1124] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:03.260082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:03.260522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:03.260620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:03.280636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:03.281839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:03.351127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 564/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:03.620273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a0f42-f18b-4317-a44f-c87cd83908f0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:03.744225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a0f42-f18b-4317-a44f-c87cd83908f0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:03.779996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:03.780614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:03.780890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:03.781191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] PATH_INFO: `/v3/roles/d598d34706594d7fa47e8399d5f9d8a0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:03.782680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] RBAC: Authorizing `identity:get_role(role_id=d598d34706594d7fa47e8399d5f9d8a0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:03.784054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:03.785404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 562/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:03 2022] GET /identity/v3/roles/d598d34706594d7fa47e8399d5f9d8a0 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:03.794943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:03.819384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:03.901182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc678-89ee-4159-bbd8-47f3a6d43bd8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:03.936362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:03.936999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:03.937277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:03.937540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] PATH_INFO: `/v3/users/6597e1aa811844988e7851fe5aa9f2b1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:03.938771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=6597e1aa811844988e7851fe5aa9f2b1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:03.940197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:03.941794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 565/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:03 2022] GET /identity/v3/users/6597e1aa811844988e7851fe5aa9f2b1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:03.948508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:03.968399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:04.062013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c595-ba97-40a4-b435-3a4f1ac382bf None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:04.099663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:04.100273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:04.100550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:04.100820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:04.170616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:04.171994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:04.185946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:04.281731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 563/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:04.288753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:04.402233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:04.415878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610dfa-fe79-4031-be1c-df4d55541ca3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:04.453591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:04.454147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:04.454430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:04.454706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] PATH_INFO: `/v3/projects/a3cefc5298c54836814e6f99b57d889a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:04.456147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] RBAC: Authorizing `identity:get_project(project_id=a3cefc5298c54836814e6f99b57d889a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:04.457629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892f63a-9c82-4491-baaf-af9615090919 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:04.459611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 566/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:04 2022] GET /identity/v3/projects/a3cefc5298c54836814e6f99b57d889a => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:04.469792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:04.587600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d36df-62cc-4bde-91a3-be7404673c6b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:04.601836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:04.629173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:04.629776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:04.630061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:04.630408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:04.631045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] RBAC: Adding query filter params (role.id=d598d34706594d7fa47e8399d5f9d8a0, scope.project.id=a3cefc5298c54836814e6f99b57d889a, user.id=6597e1aa811844988e7851fe5aa9f2b1) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:04.631351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:04.632761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbf6ca-3a63-42fc-95ae-aba4b8d6f190 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:04.638453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 564/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:38:04 2022] GET /identity/v3/role_assignments?user.id=6597e1aa811844988e7851fe5aa9f2b1&scope.project.id=a3cefc5298c54836814e6f99b57d889a&role.id=d598d34706594d7fa47e8399d5f9d8a0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:06.522388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34509d-54d4-4515-b003-72b6ab6793ca None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:06.522874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34509d-54d4-4515-b003-72b6ab6793ca None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:06.522874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34509d-54d4-4515-b003-72b6ab6793ca None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:06.524275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 567/1131] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:06.532808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:06.533254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:06.533361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:06.554716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:06.555906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:06.627476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 565/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:06.889822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34509d-54d4-4515-b003-72b6ab6793ca None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:07.012900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34509d-54d4-4515-b003-72b6ab6793ca None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:07.048785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:07.049434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:07.049711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:07.049979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:07.051204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:07.052689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705083e-9c04-4b17-a069-4fe5da737a66 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:07.054296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 568/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:07.060235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:07.162483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c2246-4b20-4867-8e85-be96280747bf None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:07.170462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:07.201863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:07.202467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:07.202746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:07.203018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:07.203656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:07.205116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc2a6c-21c2-4fbb-a0f6-034cd8f605bf None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:07.237095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 566/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:38:07 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:38:09.149324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fc89-4539-4f7b-9e36-caf5c931e907 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:09.149911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fc89-4539-4f7b-9e36-caf5c931e907 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:09.149911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0fc89-4539-4f7b-9e36-caf5c931e907 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:09.151231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 569/1135] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:09.157534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:09.158211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:09.158414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:09.191813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:09.193308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:09.266023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 567/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:09.538679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0fc89-4539-4f7b-9e36-caf5c931e907 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:09.568078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:09.648099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0fc89-4539-4f7b-9e36-caf5c931e907 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:09.685549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:09.686165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:09.686444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:09.686711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:09.687917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:09.689379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5505f98-5e6e-4ed6-890b-cf2e9d1a7152 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:09.690908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 570/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:09.697551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:09.794300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:09.807475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6044f-4ffe-4f31-b317-09d46e714107 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:09.842689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:09.843292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:09.843569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:09.843838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:09.844479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:09.845948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d737-6373-45a7-88db-ca90d93a7abc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:09.870830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 568/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:38:09 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:38:11.800776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b8eb-39d0-4bfc-bd4e-018adc72e5b6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:11.801351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b8eb-39d0-4bfc-bd4e-018adc72e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:11.801351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b8eb-39d0-4bfc-bd4e-018adc72e5b6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:11.802704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 571/1139] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:11.809226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:11.809950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:11.810100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:11.833759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:11.834950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:11.904176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 569/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:12.185537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b8eb-39d0-4bfc-bd4e-018adc72e5b6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:12.281885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:12.293663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b8eb-39d0-4bfc-bd4e-018adc72e5b6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:12.329544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:12.330484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:12.330777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:12.331044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:12.342846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:12.347601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:12.348772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:12.350164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 572/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:12.358060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:12.439688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:12.466121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152af279-5a30-4c9b-b5d9-614b373cb7de None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:12.502753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:12.503371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:12.503645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:12.503913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:12.504574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:12.505064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:12.506446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:12.514578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 570/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:12.520546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:12.633370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e0f5c-270a-42c7-b3c0-85dde4aed1e1 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:12.669740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:12.670352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:12.670625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:12.670894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] PATH_INFO: `/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:12.684182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] RBAC: Authorizing `identity:get_user(user_id=f532e0fc5a90471e8f9dbb7040ac2b83)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:12.685973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:12.687556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 573/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:12 2022] GET /identity/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:12.695708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:12.822442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa129-7cea-4b21-bc98-f869efa04e85 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:12.858041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:12.858631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:12.858910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:12.859183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:12.862715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:12.929275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:12.930726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:13.033526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 571/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:13.040033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:13.052921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:13.148480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ccaef-1778-49ec-a04d-144c943d6c70 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:13.185558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:13.186175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:13.186446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:13.186714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] PATH_INFO: `/v3/projects/8ca0a71e935647748950e96b76d5f6d3` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:13.187946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] RBAC: Authorizing `identity:get_project(project_id=8ca0a71e935647748950e96b76d5f6d3)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:13.189420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb2ff3-b0ac-492b-a9f8-618b082cbe9a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:13.191036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 574/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:13 2022] GET /identity/v3/projects/8ca0a71e935647748950e96b76d5f6d3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:13.198060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:13.235787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:13.303466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a114518-a9c9-415a-b80b-b161c06323d6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:13.340828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:13.341458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:13.341734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:13.342004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:13.342720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=8ca0a71e935647748950e96b76d5f6d3, user.id=f532e0fc5a90471e8f9dbb7040ac2b83) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:13.343025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:13.344456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e147c7-5f4c-4a36-9a9d-7f4e2c960f83 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:13.349960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 572/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:38:13 2022] GET /identity/v3/role_assignments?user.id=f532e0fc5a90471e8f9dbb7040ac2b83&scope.project.id=8ca0a71e935647748950e96b76d5f6d3&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:15.192642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c348-5efc-4839-ab5b-211266a99a19 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:15.193550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c348-5efc-4839-ab5b-211266a99a19 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:15.193781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c348-5efc-4839-ab5b-211266a99a19 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:15.195999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 575/1147] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:15.202292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:15.202726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:15.202856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:15.225554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:15.226750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:15.296796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 573/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:15.559804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c348-5efc-4839-ab5b-211266a99a19 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:15.651436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:15.677273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c348-5efc-4839-ab5b-211266a99a19 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:15.716274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:15.716894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:15.717209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:15.717485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:15.732822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:15.737691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:15.738746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:15.739854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 576/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:15.748022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:15.786108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:15.859856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84679ad-95c1-45ef-b5ee-6328f797b700 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:15.895749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:15.896347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:15.896625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:15.896889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:15.897569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:15.897869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:15.899228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:15.908300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 574/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:15.915134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:16.033859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230651-58a7-44de-b22e-ee78dccdf5d4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:16.066531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:16.067195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:16.067468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:16.067705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] PATH_INFO: `/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:16.068899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] RBAC: Authorizing `identity:get_user(user_id=f532e0fc5a90471e8f9dbb7040ac2b83)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:16.070363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:16.071940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 577/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:15 2022] GET /identity/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:16.081017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:16.179466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:16.190337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4b82-54d5-4f52-b431-8ead5bda37c1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:16.228333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:16.228945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:16.229230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:16.229500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] PATH_INFO: `/v3/projects/8ca0a71e935647748950e96b76d5f6d3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:16.230730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca0a71e935647748950e96b76d5f6d3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:16.232164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342b01c-39b2-44fc-b381-d94a62ae40b8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:16.233813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 575/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:16 2022] GET /identity/v3/projects/8ca0a71e935647748950e96b76d5f6d3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:16.240007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:16.250382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:16.348182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8fc5-31eb-4741-a4c9-a17c3f745db4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:16.382926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:16.383563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:16.383838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:16.384103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] PATH_INFO: `/v3/projects/8ca0a71e935647748950e96b76d5f6d3/users/f532e0fc5a90471e8f9dbb7040ac2b83/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:16.386243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ca0a71e935647748950e96b76d5f6d3, user_id=f532e0fc5a90471e8f9dbb7040ac2b83, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:16.387673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e23c4-3530-4e6e-b639-a4f51a8754d4 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:16.406694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 578/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:38:16 2022] PUT /identity/v3/projects/8ca0a71e935647748950e96b76d5f6d3/users/f532e0fc5a90471e8f9dbb7040ac2b83/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:38:18.256075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a692-c37a-4029-9124-0192e885bf61 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:18.256909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a692-c37a-4029-9124-0192e885bf61 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:18.256909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a692-c37a-4029-9124-0192e885bf61 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:18.259106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 576/1154] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:18.265428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:18.266138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:18.266286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:18.288802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:18.290025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:18.354906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:18.366057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 579/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:18.636188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99a692-c37a-4029-9124-0192e885bf61 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:18.751803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99a692-c37a-4029-9124-0192e885bf61 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:18.787396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:18.788002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:18.788274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:18.788539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:18.799323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:18.804043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:18.805128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:38:18.806165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 577/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:18.811274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:18.921348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7be05f-2c95-4ffd-838e-f176071004a8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:18.961628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:18.962223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:18.962518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:18.962759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:18.963407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:18.963701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:18.965091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:18.973122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 580/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:18.979899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:19.005853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:19.086447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6a9c-fb66-4876-add2-a489bd249fcf None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:19.120677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:19.121322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:19.121596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:19.121862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] PATH_INFO: `/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:19.123011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] RBAC: Authorizing `identity:get_user(user_id=f532e0fc5a90471e8f9dbb7040ac2b83)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:19.124439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:19.126014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 578/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:18 2022] GET /identity/v3/users/f532e0fc5a90471e8f9dbb7040ac2b83 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:19.132350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:19.213798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:19.264660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527329-142b-4309-a178-0d0c8502b8e5 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:19.310245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:19.310883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:19.311113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:19.311384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:19.383042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:19.384496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:19.441975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:19.507436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 581/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:19.513653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:19.628750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:19.642471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e60c-d93d-4672-9f51-4bc106c95084 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:19.686387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:19.687010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:19.687292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:19.687560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] PATH_INFO: `/v3/projects/8ca0a71e935647748950e96b76d5f6d3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:19.688740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca0a71e935647748950e96b76d5f6d3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:19.690218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347636-da1b-48d4-a848-1d168f02b867 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:19.691836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 579/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:19 2022] GET /identity/v3/projects/8ca0a71e935647748950e96b76d5f6d3 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:19.698492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:19.810600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f7b47-614d-43ec-874f-c0b2e48cc0e3 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:19.847468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:19.848068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:19.848549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:19.849451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:19.850680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=8ca0a71e935647748950e96b76d5f6d3, user.id=f532e0fc5a90471e8f9dbb7040ac2b83) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:19.851178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:19.853523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7585c-8b4b-4b76-ae75-73bdf6a21b9c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:19.863171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 582/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:38:19 2022] GET /identity/v3/role_assignments?user.id=f532e0fc5a90471e8f9dbb7040ac2b83&scope.project.id=8ca0a71e935647748950e96b76d5f6d3&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:21.842696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832e16-8058-4e76-98c5-797f7aaf8f1b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:21.843569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832e16-8058-4e76-98c5-797f7aaf8f1b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:21.843569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832e16-8058-4e76-98c5-797f7aaf8f1b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:21.845784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 580/1162] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:21.852256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:21.852683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:21.852818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:21.877182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:21.878374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:21.897797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:21.951312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 583/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:22.214843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832e16-8058-4e76-98c5-797f7aaf8f1b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:22.325998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832e16-8058-4e76-98c5-797f7aaf8f1b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:22.360769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:22.361381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:22.361620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:22.361900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:22.386566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:22.438423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:22.439874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:22.546066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 581/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:22.554326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:22.653219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e8286-0de1-4bb7-9521-67fbe0310070 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:22.688303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:22.688914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:22.689217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:22.689484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:22.696379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:22.697851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-27b83cc6-0b82-4c9b-a1ab-4c84e07f38ae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:22.709679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:22.710837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:22.711809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 584/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:38:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:22.717541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:22.785652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:22.832113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a362b-3307-4323-8007-647e2e1c913f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:22.880733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:22.881365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:22.881615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:22.881886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:22.882517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:22.882811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:22.884179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc57ce-0347-4b27-9b7e-8550955f64e7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:22.892021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 582/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 11:38:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:24.732734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e58932-4bba-4c4a-8065-abfa4c86d1ed None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:24.733322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e58932-4bba-4c4a-8065-abfa4c86d1ed None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:24.733322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e58932-4bba-4c4a-8065-abfa4c86d1ed None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:24.734637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 585/1167] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:24.741159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa64-d372-4762-b1d5-a1d87312959d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:24.741888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa64-d372-4762-b1d5-a1d87312959d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:24.742024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457caa64-d372-4762-b1d5-a1d87312959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:24.772303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-457caa64-d372-4762-b1d5-a1d87312959d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:24.773529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-457caa64-d372-4762-b1d5-a1d87312959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:24.844619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 583/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:25.111883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e58932-4bba-4c4a-8065-abfa4c86d1ed None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:25.130125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:25.233786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e58932-4bba-4c4a-8065-abfa4c86d1ed None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:25.268136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:25.268770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:25.269072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:25.269338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:25.270056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:25.271469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63ff64-8e3e-4673-b037-4d82d7791286 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:25.290285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 586/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Tue Aug 30 11:38:25 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:38:27.171648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87fe1-d351-4090-8b96-c2c035c2b471 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:27.172207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87fe1-d351-4090-8b96-c2c035c2b471 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:27.172207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd87fe1-d351-4090-8b96-c2c035c2b471 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:27.173556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 584/1170] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:27.179118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:27.179552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:27.179643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:27.203687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:27.204891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:27.276723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 587/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:27.542269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd87fe1-d351-4090-8b96-c2c035c2b471 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:27.609596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:27.663527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd87fe1-d351-4090-8b96-c2c035c2b471 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:27.704515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:27.705873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:27.706298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:27.706720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] PATH_INFO: `/v3/domains/c21911106a8b44908660daf6fd5b833a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:27.718843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] RBAC: Authorizing `identity:get_domain(domain_id=c21911106a8b44908660daf6fd5b833a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:27.720306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a2c30-36d9-41ba-8cb2-03232716518f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:27.721901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 585/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Aug 30 11:38:27 2022] GET /identity/v3/domains/c21911106a8b44908660daf6fd5b833a => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:27.728062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:27.730312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:27.845635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ee4de-05be-4219-b233-ee3858cd024d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:27.880578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:27.881201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:27.881479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:27.881742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:27.882384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:27.883819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038eebe-2e5c-42a3-80b8-80e7e945a1c7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:27.917148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 588/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:38:27 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:38:29.822947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6eac-3fb6-4ae2-93bc-f5fe438fe0ab None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:29.823550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6eac-3fb6-4ae2-93bc-f5fe438fe0ab None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:29.823550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6eac-3fb6-4ae2-93bc-f5fe438fe0ab None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:29.824797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 586/1174] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:29.831535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:29.832251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:29.832765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:29.858989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:29.860200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:29.913745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:29.933545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 589/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:30.197184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6eac-3fb6-4ae2-93bc-f5fe438fe0ab None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:30.326605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6eac-3fb6-4ae2-93bc-f5fe438fe0ab None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:30.337825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:30.363559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:30.364216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:30.364485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:30.364755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] PATH_INFO: `/v3/domains/c21911106a8b44908660daf6fd5b833a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:30.365939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c21911106a8b44908660daf6fd5b833a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:30.367377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf200c3-68e5-4559-8215-bb328a01a4e9 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:30.368912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 587/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Aug 30 11:38:30 2022] GET /identity/v3/domains/c21911106a8b44908660daf6fd5b833a => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:30.375183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:30.479260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3f81-e9e4-42bd-8820-9d21d0944f3a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:30.520785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:30.521426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:30.521697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:30.521965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:30.522613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:30.524054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ef14-5917-455d-ad85-a200c2763ce0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:30.547569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 590/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:38:30 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:38:32.476205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd113-0305-4212-ba30-70b3a38b9fbd None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:32.476794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd113-0305-4212-ba30-70b3a38b9fbd None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:32.476794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd113-0305-4212-ba30-70b3a38b9fbd None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:32.478094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 588/1178] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:32.484529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:32.485006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:32.485111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:32.506095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:32.507288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:32.547692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:32.585451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 591/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:32.853535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd113-0305-4212-ba30-70b3a38b9fbd None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:32.972617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd113-0305-4212-ba30-70b3a38b9fbd None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:33.010288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:33.010897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:33.011171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:33.011439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:33.023872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:33.028548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:33.029729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:38:33.031406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 589/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:33.039836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:33.149949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6868a0-c17b-4d31-aaef-bb3949a06881 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:33.192937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:33.193710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:33.194063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:33.194255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:33.194957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:33.195224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:33.196717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:33.204850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 592/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:33.211888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:33.254062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:33.314920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64dbf6-abe0-4917-919f-b68a53106214 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:33.350303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:33.350918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:33.351214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:33.351484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] PATH_INFO: `/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:33.367432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ebeeebf9513e4a4fba180f38c4c70d4b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:33.368915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:33.370599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 590/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:33 2022] GET /identity/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:33.377095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:33.410303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:33.486394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f88-2a17-40ae-9ed3-0d7bc3003bce None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:33.525008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:33.525652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:33.525932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:33.526200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:33.599269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:33.600715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:33.631859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:33.716503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 593/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:33.723312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:33.831560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:33.841148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391bb2e-37f3-4eea-be62-6f0e0ec0a1d7 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:33.884711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:33.885364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:33.885641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:33.885913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] PATH_INFO: `/v3/projects/b2403723dfc74a81845c7859a8b74398` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:33.887144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] RBAC: Authorizing `identity:get_project(project_id=b2403723dfc74a81845c7859a8b74398)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:33.888570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a3808-2ed1-457a-8a7d-7c17c4f8728b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:33.890205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 591/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:33 2022] GET /identity/v3/projects/b2403723dfc74a81845c7859a8b74398 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:33.898805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:34.006266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a42fe-c0c8-4a52-b1d2-267375c747e6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:34.036291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:34.042825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:34.043419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:34.043697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:34.043962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:34.044668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=b2403723dfc74a81845c7859a8b74398, user.id=ebeeebf9513e4a4fba180f38c4c70d4b) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:34.044996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:34.046419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499fa03-6e1d-4f12-9eae-43d4212363e2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:34.052420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 594/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:38:33 2022] GET /identity/v3/role_assignments?user.id=ebeeebf9513e4a4fba180f38c4c70d4b&scope.project.id=b2403723dfc74a81845c7859a8b74398&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:35.912038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408500-5a85-43ab-adea-cc94521ea9c2 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:35.912618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408500-5a85-43ab-adea-cc94521ea9c2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:35.912618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408500-5a85-43ab-adea-cc94521ea9c2 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:35.913925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 592/1186] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:35.920058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:35.920488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:35.920629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:35.948180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:35.949411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:36.032855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 595/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:36.301291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408500-5a85-43ab-adea-cc94521ea9c2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:36.421684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408500-5a85-43ab-adea-cc94521ea9c2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:36.462316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:36.462939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:36.463214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:36.463529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:36.474779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:36.479773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:36.480855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:38:36.481773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 593/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:36.487785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:36.634649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baf1c9-452b-4d28-ac28-4d360ab8cdc0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:36.670334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:36.685322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:36.685944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:36.686223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:36.686494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:36.687401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:36.687935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:36.689586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:36.703466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 596/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:36.711747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:36.746454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:36.840566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65033f5-7e16-4c97-8b68-460a3fa45471 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:36.878528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:36.879162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:36.879604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:36.879885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] PATH_INFO: `/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:36.881091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] RBAC: Authorizing `identity:get_user(user_id=ebeeebf9513e4a4fba180f38c4c70d4b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:36.882536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:36.884134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 594/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:36 2022] GET /identity/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:36.890343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:37.005157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea419-e5ae-4366-ac17-0bfd036213ec None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:37.053245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:37.053882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:37.054163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:37.054439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] PATH_INFO: `/v3/projects/b2403723dfc74a81845c7859a8b74398` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:37.055714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] RBAC: Authorizing `identity:get_project(project_id=b2403723dfc74a81845c7859a8b74398)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:37.057197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4db0b8-61b1-4c43-98b5-d8de32cf1e9d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:37.058865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 597/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:36 2022] GET /identity/v3/projects/b2403723dfc74a81845c7859a8b74398 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:38:37.065127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:37.161163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:37.172920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432d6f2-df3b-4efc-b18d-ec51a5d579cc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:37.222745 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:37.223812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:37.224233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:37.224715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] PATH_INFO: `/v3/projects/b2403723dfc74a81845c7859a8b74398/users/ebeeebf9513e4a4fba180f38c4c70d4b/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:37.227919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2403723dfc74a81845c7859a8b74398, user_id=ebeeebf9513e4a4fba180f38c4c70d4b, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:37.229743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37f0c-c052-4846-935b-77432e462416 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:37.245591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 595/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:38:37 2022] PUT /identity/v3/projects/b2403723dfc74a81845c7859a8b74398/users/ebeeebf9513e4a4fba180f38c4c70d4b/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:38:39.105371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc727-ed36-421a-a63a-c599c83313aa None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:39.106101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc727-ed36-421a-a63a-c599c83313aa None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:39.106101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc727-ed36-421a-a63a-c599c83313aa None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:39.108328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 598/1193] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:38:39.114432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:39.114866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:39.114966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:39.134341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:38:39.135523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:38:39.210607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 596/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:38:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:38:39.473679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc727-ed36-421a-a63a-c599c83313aa None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:39.549718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:39.599515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc727-ed36-421a-a63a-c599c83313aa None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:39.634195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:39.634808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:39.635085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:39.635348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:39.646483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:38:39.651166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:38:39.652216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:38:39.653238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 599/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:38:39.659012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:39.744219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:39.771536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0682d-c209-4dc6-94c0-d00765042edb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:39.809697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:39.810286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:39.810560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:39.810828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:39.811506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:39.811802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:39.813199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:39.822190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 597/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:39.828247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:39.934259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9e86-6a7a-482f-8d75-464285abaf12 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:39.951000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:39.971632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:39.972262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:39.972536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:39.972810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] PATH_INFO: `/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:39.974106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] RBAC: Authorizing `identity:get_user(user_id=ebeeebf9513e4a4fba180f38c4c70d4b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:39.975541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:39.977147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 600/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 11:38:39 2022] GET /identity/v3/users/ebeeebf9513e4a4fba180f38c4c70d4b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:38:39.983514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:40.097167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f890f-dc9d-4b75-a1f0-a6ad5ffd9acd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:40.142112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:40.142722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:40.142966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:40.143231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:40.157727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:40.226781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:40.228219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:40.335678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 598/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:38:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:38:40.345554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:40.457326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98255c-48a2-4fb0-aec4-ed13c93e1073 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:40.492942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:40.493604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:40.493882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:40.494149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] PATH_INFO: `/v3/projects/b2403723dfc74a81845c7859a8b74398` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:40.495450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] RBAC: Authorizing `identity:get_project(project_id=b2403723dfc74a81845c7859a8b74398)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:40.496939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262be29-d573-46b1-8a98-0d6aedbeaf65 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:40.498601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 601/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 11:38:40 2022] GET /identity/v3/projects/b2403723dfc74a81845c7859a8b74398 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:40.505271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:38:40.551174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:40.607031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81ced6-67e8-400a-87b3-d1f721e57bd1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:38:40.645450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:38:40.646177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:38:40.646455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:38:40.646724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:38:40.647453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=b2403723dfc74a81845c7859a8b74398, user.id=ebeeebf9513e4a4fba180f38c4c70d4b) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:38:40.647759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:38:40.649220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef8a54-427b-4d37-9a02-f42bfb1c9623 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:38:40.655113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 599/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:38:40 2022] GET /identity/v3/role_assignments?user.id=ebeeebf9513e4a4fba180f38c4c70d4b&scope.project.id=b2403723dfc74a81845c7859a8b74398&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:38:50.487180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=74 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:38:50.652481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=46 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:35.911774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc604-a04c-42f9-9442-dce50fa3653d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:35.911774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc604-a04c-42f9-9442-dce50fa3653d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:35.911774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc604-a04c-42f9-9442-dce50fa3653d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:35.911774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 602/1201] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:39:35.918042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:35.918541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:35.918735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:35.939574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:35.940901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:36.033892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 600/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:39:36.338408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cc604-a04c-42f9-9442-dce50fa3653d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:36.474027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cc604-a04c-42f9-9442-dce50fa3653d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:36.522261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:36.522261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:36.522585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:36.522585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:36.535864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:36.537394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:36.561705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:36.563044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:36.564024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:36.564024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:36.564024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:36.564024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 603/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:36.569442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:36.702161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce7a1a-a2bd-474c-baf7-0498f0fc96ee None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:36.738899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:36.745991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:36.747055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:36.747629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:36.748082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:36.748931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:36.749419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:36.750892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e795f0-6d4a-468d-aad3-b5823e281ab0 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:36.764014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 601/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:36.770385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:36.838962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:36.900760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829c3d-f8b7-4593-8e04-f10c13b3ee76 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:36.947479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:36.948191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:36.948437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:36.948675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:36.949399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:36.951039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9fc98-6c25-4310-b3ed-8b727dda33ac None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:36.990790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 604/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 11:39:36 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:39:39.122376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7276-15d8-46cd-8e95-12f946b4beca None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:39.122969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7276-15d8-46cd-8e95-12f946b4beca None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:39.122969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b7276-15d8-46cd-8e95-12f946b4beca None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:39.124642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 602/1206] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:39:39.130956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf06d-5753-48d4-8473-242f119044db None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:39.131507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf06d-5753-48d4-8473-242f119044db None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:39.132936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf06d-5753-48d4-8473-242f119044db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:39.154010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e56cf06d-5753-48d4-8473-242f119044db None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:39.155553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e56cf06d-5753-48d4-8473-242f119044db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:39.261709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 605/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:39:39.530808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b7276-15d8-46cd-8e95-12f946b4beca None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:39.656836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b7276-15d8-46cd-8e95-12f946b4beca None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:39.693161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:39.693861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:39.694142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:39.694408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:39.706576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:39:39.711752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:39.713459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:39.714619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 603/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:39.720181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf06d-5753-48d4-8473-242f119044db None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:39.767180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:39.835642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf06d-5753-48d4-8473-242f119044db None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:39.872801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:39.873437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:39.873711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:39.873994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:39.874733 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:39.875105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:39.876576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:39.885673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 606/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:39.891533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:39.948020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:40.010231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ed721-7c5d-41d4-8a87-bb2dcfa22be8 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:40.050213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:40.050978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:40.051335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:40.051606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:40.063565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:40.065049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:40.081168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:40.082452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:40.083372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:40.083372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:40.083372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:40.083372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 604/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:40.088473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:40.199843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:40.203183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a4b5-f73d-4676-b1a8-581a0f0e6d6b None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:40.240812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:40.241526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:40.241957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:40.242178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:40.243004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:40.243334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:40.244833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:40.262612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 607/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:40.263882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:40.372178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595338-5501-4fb5-a5ba-bd2cac6efe7d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:40.374638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:40.413747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:40.414702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:40.414979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:40.415253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:40.424496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:40.426903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:39:40.439941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:40.441893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:40.442883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 605/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:40.447419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:40.573717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f372-5baa-4f97-9625-eccd7ceb34d6 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:40.610856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:40.611486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:40.611754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:40.612025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:40.612914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:40.613544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:40.614925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:40.636518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 608/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:39:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:40.642084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:40.757893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9cb1-fbd2-4580-9ebe-4096ce33bfeb None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:40.798769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:40.799912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:40.801124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:40.801572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:40.837225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:40.879464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:40.881335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:40.994128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 606/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:39:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:39:41.001476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:41.024420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:41.128333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bdfe-9e4e-42c9-9c39-8deabd9bee1e None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:41.164441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:41.165092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:41.165402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:41.165677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:41.177372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:41.178839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:41.194067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:41.195088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:41.195997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:41.195997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:41.195997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:41.195997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 609/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:41.201190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:41.270219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:41.312518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f35281-60fc-4fab-8fb4-bbf1db791e99 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:41.351966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:41.352729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:41.353079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:41.353377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:41.354017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:41.354306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:41.355682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:41.369862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 607/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:41.375672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:41.470521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:41.518242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc706-9bbc-4053-98bd-7b86b398ca79 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:41.559878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:41.560513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:41.560840 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:41.561143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:41.569728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:41.571224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:39:41.585172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:41.586123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:41.587060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:41.589305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 610/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:39:41.592112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:41.713850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1057269-cac8-46ca-90e8-f0199c7ae29f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:41.754436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:41.771416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:41.772040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:41.772361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:41.772587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:41.773363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:41.773669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:41.775206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261496-863c-4404-9770-c1afe45967f2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:41.792449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 608/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:41.799179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:41.909880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a3e7-5fe2-481b-ae1e-27a91a0b1a51 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:41.940572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:41.948122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:41.948732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:41.949041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:41.949319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:41.950045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=f34fbf3ab49044968bff90c32f730c4d) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:41.950357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:41.951786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f632ac-de58-4bfe-85f8-2ebe44562a66 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:41.969004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 611/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:39:41 2022] GET /identity/v3/role_assignments?user.id=f34fbf3ab49044968bff90c32f730c4d&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:43.980198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72ad3-113e-418c-b79e-59c0d54e18b4 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:43.980806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72ad3-113e-418c-b79e-59c0d54e18b4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:43.980806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72ad3-113e-418c-b79e-59c0d54e18b4 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:43.982166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 609/1220] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:39:43.989652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:43.990190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:43.990358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:44.013445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:44.014900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:44.091782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 612/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:39:44.374251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df72ad3-113e-418c-b79e-59c0d54e18b4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:44.500736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df72ad3-113e-418c-b79e-59c0d54e18b4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:44.537588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:44.538218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:44.538493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:44.538763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:44.549577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:39:44.554529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:44.555535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:44.556411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 610/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:44.561758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:44.665856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa5ed0-8bcd-4fae-8a33-3bb901877ad5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:44.689296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:44.701231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:44.702084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:44.702580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:44.703025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:44.704112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] RBAC: Adding query filter params (name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:44.704710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:44.706670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:44.716063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 613/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:44.722116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:44.765964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:44.825903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3f98-318b-4f29-85d2-f5d96711875c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:44.860732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:44.861393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:44.861700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:44.861971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:44.873095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:44.874634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:44.889551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:44.890731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:44.892003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:44.892003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:44.892003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:44.892003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 611/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:44.897293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.011965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fc7e-9dd5-4e3c-aed6-8e8b2db36549 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.049107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.049724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.050052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.050467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.051085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:45.051481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.052913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.066320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 614/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:45.072258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.176120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:45.185079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a78d1b-12ef-418c-bc20-241c0dc6db18 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.223365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.224105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.224463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.224739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.232719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.234268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:39:45.246657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:45.247943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:45.248893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 612/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:45.254273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.304944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:45.366638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662c8b-ba53-4c20-8e3a-7e88815ee7df None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.406482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.409842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.410158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.410493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.411260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:45.411685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.413333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.432571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 615/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:39:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:45.438603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.553355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de743d5-c81d-46a7-b336-6096e8ca362b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.589556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.590116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.590461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.590868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.603531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.605150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:45.620838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:45.622064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:45.623403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:45.623403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:45.623403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:45.626769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 613/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:45.628070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.742986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6c7d1-4d18-48ab-9c2a-80bda3f90a1f None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.746169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:45.787727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.788385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.788662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.788927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.789602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:45.789910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.791293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.803557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 616/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:45.810805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:45.823978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:45.927313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba37e7-0237-40d6-bb60-3e336ac113ed None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:45.966642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:45.967439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:45.967716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:45.968143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:45.977937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:45.979909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:39:45.995487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:45.996643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:45.997760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 614/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:46.003191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:46.113470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ee50-99cc-419c-aff7-02e1e494cd61 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:46.153915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:46.154556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:46.154976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:46.155274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:46.156031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:46.156375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:46.158219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7917-9f33-4926-8216-6773742091c7 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:46.170966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 617/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:46.178889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:46.250180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:46.291894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332080c3-c371-451d-be9e-a13ba575f388 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:46.330716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:46.331492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:46.331771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:46.332041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/f34fbf3ab49044968bff90c32f730c4d/roles/1d6791401c8d4bb2840965eb6473a606` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:46.350363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=f34fbf3ab49044968bff90c32f730c4d, role_id=1d6791401c8d4bb2840965eb6473a606)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:46.352201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1a02-e022-4d50-ac82-7f7d6e05ced8 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:46.366254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 615/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:39:46 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/f34fbf3ab49044968bff90c32f730c4d/roles/1d6791401c8d4bb2840965eb6473a606 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:39:48.268132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262272-7356-47d3-8e1d-4204076f5250 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:48.268820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262272-7356-47d3-8e1d-4204076f5250 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:48.268820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262272-7356-47d3-8e1d-4204076f5250 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:48.270319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 618/1233] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:39:48.275608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:48.276058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:48.276151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:48.301718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:48.302921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:48.377682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 616/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:39:48.688748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8262272-7356-47d3-8e1d-4204076f5250 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:48.717646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:48.802144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8262272-7356-47d3-8e1d-4204076f5250 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:48.856277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:48.856906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:48.857211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:48.857486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:48.874506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:39:48.879289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:48.880484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:48.881437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 619/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 11:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:48.887384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:48.939006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:49.010450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe35e1e-fa02-4676-8d66-2fe0133aa3cb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.050286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.050814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.051058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.051336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:49.052004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:49.052310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:49.053725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:49.067475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 617/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 11:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:49.069238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:49.171567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:49.189821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c47d9-e865-48c8-a943-66a3a1ed89e4 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.238104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.238861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.239235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.239539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:49.251055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:49.252548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:49.269581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:49.271074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:49.272000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:49.272000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:49.272000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:49.272000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 620/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:49.276873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:49.390571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc5b1b-3280-4a12-93de-3f8e0613a1a6 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.401701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:49.431919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.432609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.432911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.433252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:49.434009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:49.434372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:49.435967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:49.450991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 618/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:49.457962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:49.567952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb4b5-ede1-4616-985c-23df1a8ce515 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.604392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.605261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.605676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.606037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:49.608930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:49.614440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:49.616195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:39:49.628243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:49.629855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:49.630914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 621/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:49.635475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:49.743338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6998-656f-4a74-a3d3-a55486a0049c None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.783990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.784727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.785034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.785349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:49.786176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:49.786512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:49.788658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:49.809429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 619/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:39:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:49.816089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:49.933824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f11d-ea30-48c1-a595-e54a74759b98 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:49.969871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:49.970481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:49.970746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:49.971035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:50.039455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:50.047200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:50.048672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:50.159956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 622/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:39:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:39:50.161497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:50.189523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:50.276081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc57a23-dc5c-4a75-9ce7-fd19ed845c00 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:50.310975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:50.311606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:50.311795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:50.312061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:50.325119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:50.325119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:50.340534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:50.341643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:50.342553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:50.342553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:50.342553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:50.342553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 620/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:50.347603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:50.445996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:50.452627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91219-2725-48fe-b814-c3deb4a168c9 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:50.488716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:50.489367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:50.489643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:50.489912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:50.490551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:50.490875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:50.492241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:50.504776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 623/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:50.510625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:50.592536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:50.618094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c51f-3ccd-4505-b06b-419ae730e3bc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:50.653324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:50.654099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:50.654415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:50.654750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:50.662377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:50.663945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:39:50.675314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:50.676229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:50.677461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 621/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:50.682699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:50.785633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5b2f-8211-4893-bc61-62879d0d4a8a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:50.824519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:50.825188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:50.825420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:50.825793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:50.826469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:50.826849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:50.828377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275e5e8-863a-4306-aabf-07aefc4e1e9c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:50.842381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 624/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:50.848775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:50.961785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5dbf-2947-4adf-9a1d-555261ac5959 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:51.013692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:51.014490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:51.014819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:51.015171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:51.016400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] RBAC: Adding query filter params (role.id=1d6791401c8d4bb2840965eb6473a606, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=f34fbf3ab49044968bff90c32f730c4d) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:51.016929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:51.019214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd60dc-f3f5-432d-af32-331ed5ad7e71 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:51.027266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 622/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:39:50 2022] GET /identity/v3/role_assignments?user.id=f34fbf3ab49044968bff90c32f730c4d&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=1d6791401c8d4bb2840965eb6473a606 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:53.106559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d287-2e0d-4a83-a92d-b7c34018f239 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:53.107127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d287-2e0d-4a83-a92d-b7c34018f239 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:53.107127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d287-2e0d-4a83-a92d-b7c34018f239 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:53.108454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 625/1247] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:39:53.114341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:53.114797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:53.114918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:53.122097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:53.137308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:53.138545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:53.218723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 623/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:39:53.482007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d287-2e0d-4a83-a92d-b7c34018f239 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:53.504098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:53.596399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d287-2e0d-4a83-a92d-b7c34018f239 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:53.639398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:53.640036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:53.640317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:53.640594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:53.650987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:39:53.655743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:53.658204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:53.659374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 626/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:53.663746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:53.780979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feef0-0221-4f73-ab4b-4a3788ed18eb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:53.813340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:53.819814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:53.820507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:53.820784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:53.821090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:53.821757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:53.822678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:53.824070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:53.833365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 624/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:53.839458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:53.928450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:53.954921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305f1a3-db08-46c5-880e-6a7580252b42 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:53.995926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:53.996596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:53.996885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:53.997198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:54.010445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:54.012242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:54.033472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:54.034520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:54.035526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:54.035526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:54.035526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:54.035526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 627/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:54.041768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:54.163549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582447-b71c-4696-83cb-41eb7f1f525b None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:54.200728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:54.201503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:54.201792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:54.202074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:54.202742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:54.203045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:54.204604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:54.217780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 625/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:54.226092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:54.329288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f08aa-8e9d-4e0d-ba02-21a451bdb4d2 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:54.361203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:54.370513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:54.371172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:54.371431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:54.371780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:54.380551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:54.382133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:39:54.393621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:54.394640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:54.395826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 628/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:54.401300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:54.464242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:54.516917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb4bc1-aee5-41fa-bc68-f00d8916bcf2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:54.555171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:54.555786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:54.556067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:54.556341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:54.557106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:54.557414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:54.558858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:54.576011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 626/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:39:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:54.582389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:54.690833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d0276-8983-4362-889b-a81b6c09157d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:54.728634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:54.729294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:54.729606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:54.729943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:54.787923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:54.800891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:54.802375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:54.908241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 629/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:39:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:39:54.914308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:55.037301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a6abf-190b-4c27-ad17-2a5214de2ea1 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:55.054830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:55.079235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:55.079873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:55.080150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:55.080735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:55.092373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:55.093988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:55.110549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:55.111740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:55.113320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:55.113320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:55.113320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:55.113320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 627/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:55.118113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:55.217907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:55.231512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc4e9-aa38-4f1f-9e78-9ee27bdf1472 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:55.266996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:55.267606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:55.267886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:55.268157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:55.269066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:55.269443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:55.270812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:55.282328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 630/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:55.289069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:55.397948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc090797-c884-4827-99c8-8a2c07a1e8df None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:55.434027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:55.434746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:55.435036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:55.435357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:55.442513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:55.443965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:39:55.456336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:55.457417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:39:55.458331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 628/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:55.463674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:55.568306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568348b-1e60-458a-ac26-f4a12e2e4a47 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:55.605161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:55.605783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:55.606063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:55.606339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:55.607038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:55.607348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:55.608784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf89ecd-8ec1-41e7-a376-e056d883a884 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:55.622105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 631/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:55.628596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:55.656899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:55.732889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040ade3-0cdb-4b92-9512-3c13acb24c5e None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:55.767013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:55.767580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:55.767853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:55.768118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:55.769060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=f34fbf3ab49044968bff90c32f730c4d) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:55.769376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:55.770795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd8c2-411f-400b-b69f-e5221dd4d818 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:55.777097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 629/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:39:55 2022] GET /identity/v3/role_assignments?user.id=f34fbf3ab49044968bff90c32f730c4d&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:57.669628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366375-b45a-457d-9d44-95f04888ff39 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:57.670179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366375-b45a-457d-9d44-95f04888ff39 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:57.670179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366375-b45a-457d-9d44-95f04888ff39 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:57.671512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 632/1261] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:39:57.678083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:57.678525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:57.678642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:57.699619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:39:57.700800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:39:57.770071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 630/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:39:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:39:58.056062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366375-b45a-457d-9d44-95f04888ff39 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:58.074752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:58.173731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366375-b45a-457d-9d44-95f04888ff39 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:58.211765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:58.212378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:58.212656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:58.212925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:58.223903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:39:58.228663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:58.229758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:58.231177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 633/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:58.239163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:58.264213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:58.363258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48dae-87b0-4b66-abf5-b4a7a798ae9d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:58.409228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:58.409840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:58.410109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:58.410380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:58.411038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:58.411340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:58.412716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:58.421022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 631/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:58.427114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:58.496826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:58.534847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b8cbc-d58e-44b1-af7d-51063591bdce None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:58.571812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:58.572426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:58.572699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:58.572984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:58.584231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:58.585704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:58.600242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:58.601485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:58.602620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:58.602620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:58.602620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:58.602620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 634/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:58.607620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:58.697462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:58.720320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d091e3-0af7-4b6b-99b4-642ebce1339d None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:58.754196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:58.754783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:58.755056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:58.755322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:58.755955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:58.756248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:58.757645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:58.769493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 632/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:39:58.776110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:58.887542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3097c98-85fd-4d52-b9aa-559973d3ae53 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:58.907937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:58.924669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:58.925457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:58.925735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:58.926010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:58.933744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:58.935193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:39:58.946652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:58.947784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:58.948949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 635/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:58.953814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.061348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09b70f-0436-4acd-91a4-2d31dc8ec8d2 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.098536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.099123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.099399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.099666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.100371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:59.100671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.102124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:59.110615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:59.119228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 633/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:39:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:59.125463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.251872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b421e-6d24-4561-a7f8-590b62b16b6a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.289178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.289804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.290084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.290354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.301312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.302747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:39:59.317186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:59.318175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:39:59.319110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:39:59.319110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:39:59.319110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:59.319110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 636/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:39:59.325029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.432993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8264a25-9246-46f7-aec5-c1b1e532db98 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.468330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.468911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.469210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.469477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.470102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:59.470401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.471778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:59.483950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 634/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:59.490425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.526958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:59.607265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01b7f-0318-420c-9ad4-8788cd006978 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.643026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.643781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.644240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.644512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.653694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.655433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:39:59.667368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:39:59.668371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:39:59.669512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 637/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:39:59.675092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.741604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:59.785707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1cab-f8f8-44bf-8545-e8d52de794dc None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.819413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.820006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.820276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.820542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.821249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:39:59.821546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.822955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd366b8-0855-4f9e-9edd-f1ddf9a73c5e None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:39:59.835278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 635/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:39:59.841639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:39:59.940026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:39:59.949870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770896-3e56-4d9e-8b52-1c1f1b7ac239 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:39:59.993560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:39:59.994410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:39:59.994620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:39:59.994927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] PATH_INFO: `/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/f34fbf3ab49044968bff90c32f730c4d/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:39:59.997272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] RBAC: Authorizing `identity:create_grant(project_id=3159ebcbe4314d298e16f887e288ddff, user_id=f34fbf3ab49044968bff90c32f730c4d, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:39:59.998980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798baf2-4bce-4c38-857f-ba5b96e6fc5c None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:00.013312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 638/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 11:39:59 2022] PUT /identity/v3/projects/3159ebcbe4314d298e16f887e288ddff/users/f34fbf3ab49044968bff90c32f730c4d/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:40:01.906343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2718a2-8dfa-4acb-81b5-cffeda08eddf None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:01.907295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2718a2-8dfa-4acb-81b5-cffeda08eddf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:01.907295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2718a2-8dfa-4acb-81b5-cffeda08eddf None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:01.909633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 636/1274] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:40:01.915087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:01.915521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:01.915618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:01.936139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:40:01.937359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:40:02.015427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 639/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:40:02.289798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2718a2-8dfa-4acb-81b5-cffeda08eddf None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:02.407029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2718a2-8dfa-4acb-81b5-cffeda08eddf None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:02.424474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:02.454541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:02.455708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:02.456224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:02.456504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:02.467297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:40:02.472068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:02.473255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:02.474482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 637/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 11:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:02.479919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:02.569058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:02.590418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af684-2559-498f-bc4b-c4f6614148fa None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:02.641790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:02.642396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:02.642666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:02.642928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:02.643904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:02.644226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:02.645631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:02.656309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 640/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 11:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:02.666146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:02.777344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce669-a615-470a-b087-2c6a3a89b296 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:02.811344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:02.811951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:02.812222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:02.812488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:02.822698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:02.824074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:40:02.840910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:02.846937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:40:02.848122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:40:02.848122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:40:02.848122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:02.848122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 638/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:02.850180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:02.954392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443f96-ef17-44f9-aaa8-85d595ab36ff None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:02.992316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:02.993062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:02.993280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:02.993711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:02.994197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:02.994500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:02.995989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:03.007709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 641/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:03.016428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:03.048618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:03.121343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d43cc4-2557-4ce8-bf32-34461b494462 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:03.155921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:03.156527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:03.156800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:03.157096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:03.164784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:03.166355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:40:03.177824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:03.178905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:03.180019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 639/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:03.185009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:03.189001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:03.289415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f4b7-30c5-41ed-8d84-9a73429f0f97 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:03.326907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:03.327503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:03.327779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:03.328046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:03.328770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:03.329098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:03.330990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:03.348579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 642/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 11:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:03.358061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:03.457032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:03.467818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479cd74-0b10-4ec3-9544-9af845d70036 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:03.502502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:03.503247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:03.503545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:03.503812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:03.574909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:03.576364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:03.670359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:03.681841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 640/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 11:40:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:40:03.688804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:03.772878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:03.814612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f72a-84a2-448e-b879-eeeec1d8743d None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:03.850322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:03.850936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:03.851236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:03.851473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:03.861664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:03.863180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:40:03.878174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:03.879244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:40:03.880158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:40:03.880158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:40:03.880158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:40:03.880158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 643/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:03.888771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:03.988308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d3d70-f3f1-42a6-9229-2898798ac25f None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:04.023900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:04.024537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:04.024632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:04.024929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:04.025715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:04.027169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:04.027169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:04.041762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 641/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 11:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:04.047763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:04.155164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb765-3ac1-4d9f-a54f-f7dd069a6d44 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:04.170205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:04.200360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:04.200997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:04.201295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:04.201563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:04.208900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:04.210388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:40:04.222122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:04.223168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:40:04.224216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: ERROR keystone.server.flask.application Aug 30 11:40:04.225117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 644/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 11:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:04.229226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:04.298895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:04.370553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386c35-5e01-4fcf-a7f7-4dc0f3653b87 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:04.408523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:04.409175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:04.409536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:04.409964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:04.410674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:04.410974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:04.412400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f362-0ddb-4ab1-96e1-7d5c8291abdb None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:04.424576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 642/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 11:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:04.431735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:04.552094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5998c-04a4-43d2-ad2b-79f99444a31a None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:04.589152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:04.589750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:04.590030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:04.590300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:04.591029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] RBAC: Adding query filter params (role.id=5d0ba9933aef4ff28eb619a010b578b5, scope.project.id=3159ebcbe4314d298e16f887e288ddff, user.id=f34fbf3ab49044968bff90c32f730c4d) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:04.591336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:04.592780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a91a-7bbb-4146-8d43-6a0f3d5da869 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:04.598779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 645/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 11:40:04 2022] GET /identity/v3/role_assignments?user.id=f34fbf3ab49044968bff90c32f730c4d&scope.project.id=3159ebcbe4314d298e16f887e288ddff&role.id=5d0ba9933aef4ff28eb619a010b578b5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:06.460374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c477d9-0085-402f-9958-f0bdeba0c79a None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:06.461005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c477d9-0085-402f-9958-f0bdeba0c79a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:06.461005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c477d9-0085-402f-9958-f0bdeba0c79a None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:06.462262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 643/1288] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:40:06.468430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:06.469187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:06.469367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:06.491699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:40:06.492904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:40:06.530057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:06.571608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 646/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:40:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:40:06.839518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c477d9-0085-402f-9958-f0bdeba0c79a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:06.957224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c477d9-0085-402f-9958-f0bdeba0c79a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:06.969547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:07.002039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:07.003116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:07.003522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:07.003902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:07.004814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:07.006785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:07.020174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:07.021589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:07.022481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 644/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:40:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:07.028206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:07.133238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eff43-c3ed-4b01-a7e9-6afc3d06b0f6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:07.172915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:07.173553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:07.173826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:07.174095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:07.174732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:07.175024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:07.176409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da1e0-ecd4-4f0e-8c15-2c3abcf8e6f1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:07.181954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 647/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 11:40:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:40:07.187873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:07.295171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4b02-a431-462a-a84b-de1a79fa0b63 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:07.331305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:07.331922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:07.332197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:07.332465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] PATH_INFO: `/v3/services` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:07.333120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] RBAC: Adding query filter params (type=placement) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:07.333421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:07.334808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fbd85-489b-44e2-83b1-34d767edc2ba None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:07.339996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 645/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 11:40:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:09.245448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67727cb-554f-4a94-90a1-355e3153abf6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:09.246027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67727cb-554f-4a94-90a1-355e3153abf6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:09.246027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67727cb-554f-4a94-90a1-355e3153abf6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:09.248106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 648/1293] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:40:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:40:09.257042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549870-64fe-4df6-be5f-c1abf3138dab None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:09.257445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549870-64fe-4df6-be5f-c1abf3138dab None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:09.257664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549870-64fe-4df6-be5f-c1abf3138dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:09.281134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b8549870-64fe-4df6-be5f-c1abf3138dab None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:40:09.282320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b8549870-64fe-4df6-be5f-c1abf3138dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:40:09.312762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:09.353608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 646/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:40:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:40:09.630427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67727cb-554f-4a94-90a1-355e3153abf6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:09.666660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:09.742221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67727cb-554f-4a94-90a1-355e3153abf6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:09.778208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:09.778801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:09.779077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:09.779348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:09.780005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:09.781394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc394-ce91-4f3e-b266-1fb25796c6a0 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:09.798823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 649/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 11:40:09 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:40:11.659120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9aa0-c58b-402a-b1ac-44a7d78706c4 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:11.659982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9aa0-c58b-402a-b1ac-44a7d78706c4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:11.659982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9aa0-c58b-402a-b1ac-44a7d78706c4 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:11.662185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 647/1296] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:40:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:40:11.671055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:11.671463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:11.671665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:11.699307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:40:11.700495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:40:11.792828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 650/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:40:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:40:12.069680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e9aa0-c58b-402a-b1ac-44a7d78706c4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:12.183776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e9aa0-c58b-402a-b1ac-44a7d78706c4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:12.219416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:12.220021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:12.220288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:12.220553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:12.221155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:12.222654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:12.231818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:12.232990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:12.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 648/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:40:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:12.240045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:12.269719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:12.354399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c62afd-6c3b-49d8-a5b8-58352205fe5f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:12.393087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:12.393957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:12.394241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:12.394517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:12.395149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:12.395451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:12.396817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:12.402656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 651/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 11:40:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:12.408933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:12.444629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:12.526911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765d6e-112b-4278-8f73-dcd79b4ca6dd None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:12.561647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:12.562265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:12.562540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:12.562795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:12.563487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] RBAC: Adding query filter params (interface=public, service_id=301d77cd7f244ff3a8c0ef105c9b0af7, region_id=RegionOne) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:12.563790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:12.565244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a4dd-ff6e-48ff-9888-33b1dd8de065 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:12.570551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 649/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 11:40:12 2022] GET /identity/v3/endpoints?service_id=301d77cd7f244ff3a8c0ef105c9b0af7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:12.576447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:12.661214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:12.681589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70cdc2-7817-46ec-9d0a-0fe207070957 None admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:12.718126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:12.718738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:12.719017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:12.719290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:12.719899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:12.721334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bf153-86fc-4ad7-bf34-0b655ee712d1 None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:12.728522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 652/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 11:40:12 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:40:14.635589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a53-c68c-42bf-9e8a-f20574c8b4f6 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:14.636138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a53-c68c-42bf-9e8a-f20574c8b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:14.636138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a181a53-c68c-42bf-9e8a-f20574c8b4f6 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:14.637484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 650/1302] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:40:14.643904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:14.644620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:14.645173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:14.670272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:40:14.671466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:40:14.744226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 653/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:40:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:40:15.010142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a181a53-c68c-42bf-9e8a-f20574c8b4f6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:15.107568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:15.115192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a181a53-c68c-42bf-9e8a-f20574c8b4f6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:15.151080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:15.151703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:15.151979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:15.152245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:15.152816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:15.154213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:40:15.163376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:40:15.164582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application with Lock( Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: ERROR keystone.server.flask.application Aug 30 11:40:15.165519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 651/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 11:40:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:40:15.170686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:15.252130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:15.286173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dda01e-35c2-4dde-9992-885b8dc0b8e0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:15.328065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:15.328667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:15.328942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:15.329247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] PATH_INFO: `/v3/services` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:15.329883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] RBAC: Adding query filter params (name=placement) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:40:15.330193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:15.332050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e414-eb84-4fda-ad42-1944f3dce67b None admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:15.337307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 654/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 11:40:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:40:15.343843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:40:15.458191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0250dfb-8282-49ab-808a-adcb7ae8bbc3 None admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:40:15.494051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:40:15.494661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:40:15.494941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:40:15.495197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:40:15.495907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:40:15.497321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109996f-d303-44e9-9bc7-4692e7af445a None admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:40:15.519728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 652/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:40:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:40:25.334543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=30 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:40:25.515071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:18.963720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3056a-1362-40e4-9722-b95674e91ac0 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:18.964598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3056a-1362-40e4-9722-b95674e91ac0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:18.965076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3056a-1362-40e4-9722-b95674e91ac0 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:18.971993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b21d-99c5-463c-a687-ffae40628d8b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:18.972875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b21d-99c5-463c-a687-ffae40628d8b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:18.973395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b21d-99c5-463c-a687-ffae40628d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:18.978492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 655/1307] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:18 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:19.070989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b102b21d-99c5-463c-a687-ffae40628d8b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:19.072656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b102b21d-99c5-463c-a687-ffae40628d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:19.191290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 653/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:41:19.490450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:19.492793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:19.493359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:19.495260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 656/1309] 10.222.0.13 () {54 vars in 965 bytes} [Tue Aug 30 11:41:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:19.503448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61828b8-79ea-4ba1-87a9-4f4d7bdaa023 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:19.503731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61828b8-79ea-4ba1-87a9-4f4d7bdaa023 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:19.504001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61828b8-79ea-4ba1-87a9-4f4d7bdaa023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:19.585492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d61828b8-79ea-4ba1-87a9-4f4d7bdaa023 None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:19.586683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d61828b8-79ea-4ba1-87a9-4f4d7bdaa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:19.608104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:19.665428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 654/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Tue Aug 30 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:19.674265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:19.676677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:19.805962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ab62-1501-428a-ae30-f5f63f6b1417 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:19.893607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:19.894649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:19.895146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:19.895619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:19.897603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:19.966395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:20.031296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:20.032987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07151962-7ca7-4dad-8719-261ad37ea832 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:20.055064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 657/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:22.232207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:22.232865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:22.232865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:22.234156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 655/1312] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:22.240159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336977-82b5-49eb-aa54-ba1db6ab4b35 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:22.240701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336977-82b5-49eb-aa54-ba1db6ab4b35 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:22.240701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336977-82b5-49eb-aa54-ba1db6ab4b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:22.332069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3e336977-82b5-49eb-aa54-ba1db6ab4b35 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:22.333329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3e336977-82b5-49eb-aa54-ba1db6ab4b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:22.432492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 658/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:22.715934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:22.718859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:22.837989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991ae9-8d63-48fb-bdd8-02e512789bb8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:22.912319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:22.915166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:22.915844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:22.916129 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:22.916408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:22.918500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:23.032205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:23.033675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bf5da-6f37-41fc-80f3-59574dd93691 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:23.052483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 656/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:25.265669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:25.266525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:25.266525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:25.269439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 659/1315] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:25.275586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac34c-8cad-4e21-8b86-8c42718d3a1e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:25.276307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac34c-8cad-4e21-8b86-8c42718d3a1e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:25.276457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac34c-8cad-4e21-8b86-8c42718d3a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:25.355019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9a5ac34c-8cad-4e21-8b86-8c42718d3a1e None None] MFA Rules not processed for user `4294cdf4c1754def86cfd1fa0399fd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:25.356236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9a5ac34c-8cad-4e21-8b86-8c42718d3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:25.419409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:25.470823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 657/1316] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:25.751110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:25.753653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:25.768441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:25.870834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4735-8748-442b-9e44-5f8d6789a025 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:25.947438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:25.948462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:25.948773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:25.949088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:25.950867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:26.025546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:26.074579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:26.076024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6cb85-e3e2-494e-83cc-2fb739c3ee36 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:26.094785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 660/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:28.522469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c326e5-0c25-4963-932c-8ff64bad7009 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:28.523000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c326e5-0c25-4963-932c-8ff64bad7009 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:28.523000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c326e5-0c25-4963-932c-8ff64bad7009 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:28.524338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 658/1318] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:28.530840 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bde16-a9ce-4652-a43d-4af8586f98c9 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:28.531311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bde16-a9ce-4652-a43d-4af8586f98c9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:28.531475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bde16-a9ce-4652-a43d-4af8586f98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:28.607891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-924bde16-a9ce-4652-a43d-4af8586f98c9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:28.609144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-924bde16-a9ce-4652-a43d-4af8586f98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:28.708196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 661/1319] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:29.009310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:29.009752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:29.010175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:29.012348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 659/1320] 10.222.0.13 () {54 vars in 965 bytes} [Tue Aug 30 11:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:29.019333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff468e9c-21d8-4dc2-a11f-2ca56084893e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:29.019583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff468e9c-21d8-4dc2-a11f-2ca56084893e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:29.020009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff468e9c-21d8-4dc2-a11f-2ca56084893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:29.047272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:29.103518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ff468e9c-21d8-4dc2-a11f-2ca56084893e None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:29.104731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ff468e9c-21d8-4dc2-a11f-2ca56084893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:29.192040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 662/1321] 10.222.0.13 () {58 vars in 1062 bytes} [Tue Aug 30 11:41:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:29.201576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:29.203900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:29.327403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b444be-02cd-4f4c-8c40-8242e6b5f646 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:29.407097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:29.407873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:29.408164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:29.408427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:29.410042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:29.417463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:29.532577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:29.534069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5dc4a-3c1e-41a2-aeff-c2a21c2435b8 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:29.553371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 660/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:32.589256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:32.589801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:32.589801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:32.591154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 663/1323] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:32.596531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a387c5-8c9e-4595-a00a-e38063a3fd3e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:32.596951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a387c5-8c9e-4595-a00a-e38063a3fd3e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:32.597212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a387c5-8c9e-4595-a00a-e38063a3fd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:32.667944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e7a387c5-8c9e-4595-a00a-e38063a3fd3e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:32.669206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e7a387c5-8c9e-4595-a00a-e38063a3fd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:32.731166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:32.770793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 661/1324] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:33.051119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:33.052672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:33.169313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04a61-9c3d-4135-ad99-d3676863ac94 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:33.182362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:33.245506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:33.246023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:33.246294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:33.246557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:33.248139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:33.364412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:33.365786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42e39-4f79-41f8-ad99-bc428c449c48 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:33.385497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 664/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:35.314155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:35.314762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:35.314762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:35.316026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 662/1326] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:35.321256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85aa9-eab9-46ed-b6b2-16035f20b617 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:35.321695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85aa9-eab9-46ed-b6b2-16035f20b617 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:35.321802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85aa9-eab9-46ed-b6b2-16035f20b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:35.370705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:35.389496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4ef85aa9-eab9-46ed-b6b2-16035f20b617 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:35.390698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4ef85aa9-eab9-46ed-b6b2-16035f20b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:35.493527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 665/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:35.780361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:35.781950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:35.899011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eb85c-c651-442d-b437-88ccdb835991 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:35.974738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:35.975636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:35.975980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:35.976306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:35.978021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:35.996537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:36.096269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:36.097744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ececf-c62a-4e0c-9163-1f553839f53c service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:36.117059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 663/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:38.084960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:38.085435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:38.085579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:38.086905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 666/1329] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:38.092452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd654f-9150-4711-8851-b1435cef5cff None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:38.092915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd654f-9150-4711-8851-b1435cef5cff None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:38.093040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd654f-9150-4711-8851-b1435cef5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:38.167388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a0fd654f-9150-4711-8851-b1435cef5cff None None] MFA Rules not processed for user `4294cdf4c1754def86cfd1fa0399fd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:38.168595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a0fd654f-9150-4711-8851-b1435cef5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:38.240057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:38.274347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 664/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:38.561043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:38.562802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:38.680592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ec130-cb1d-4da6-b182-1093508b5f25 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:38.701210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:38.762192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:38.762727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:38.763002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:38.763276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:38.765170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:38.882839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:38.884658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312f43-c256-4994-8620-c39adfae336d service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:38.911191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 667/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:41.061524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:41.062380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:41.062380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:41.064200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 665/1332] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:41.069894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d094-76d1-4527-a832-0811a6221370 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:41.070313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d094-76d1-4527-a832-0811a6221370 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:41.070420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388d094-76d1-4527-a832-0811a6221370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:41.135571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:41.138433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9388d094-76d1-4527-a832-0811a6221370 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:41.140167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9388d094-76d1-4527-a832-0811a6221370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:41.242081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 668/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:41.519941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:41.521567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:41.637115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25ce8-d3ae-4700-8178-670449d53308 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:41.715310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:41.715908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:41.716212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:41.716418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:41.718057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:41.751620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:41.841234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:41.842677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec370f-0db6-409a-99c0-54897d8a20a5 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:41.861306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 666/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:43.803150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:43.804024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:43.804024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:43.806285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 669/1335] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:43.812403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626514f-7aff-4279-9146-1b01687f75ac None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:43.812856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626514f-7aff-4279-9146-1b01687f75ac None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:43.812959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626514f-7aff-4279-9146-1b01687f75ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:43.888832 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1626514f-7aff-4279-9146-1b01687f75ac None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:43.890063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1626514f-7aff-4279-9146-1b01687f75ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:43.974433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:44.008166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 667/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:44.301773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:44.304193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:44.439347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727815-d734-47bc-8a05-ccbe9ee9adc7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:44.475264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:44.525700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:44.526304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:44.526578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:44.526845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:44.528429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:44.640746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:44.642347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27445761-bcf6-4b53-b309-375d996fa62f service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:44.661262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 670/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:46.949875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:46.950737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:46.950737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:46.952867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 668/1338] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:46.959371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227c988-a621-42a5-b50b-e582f2006be1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:46.959820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227c988-a621-42a5-b50b-e582f2006be1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:46.959940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227c988-a621-42a5-b50b-e582f2006be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:47.044388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c227c988-a621-42a5-b50b-e582f2006be1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:47.045638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c227c988-a621-42a5-b50b-e582f2006be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:47.055071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:47.163545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 671/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:47.441486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:47.443025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:47.566101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2b6c0-fd5c-4f58-a707-91cc77a2c5a5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:47.643070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:47.643671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:47.643944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:47.644220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:47.645825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:47.681603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:47.757346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:47.758738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caa728-ef8e-4d1a-87e1-5923f2eeae58 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:47.777253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 669/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:51.719701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:51.720313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:51.720313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:51.721678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 672/1341] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:51.727320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3c50-592f-4131-8ceb-93715ccb94cb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:51.727777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3c50-592f-4131-8ceb-93715ccb94cb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:51.727874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3c50-592f-4131-8ceb-93715ccb94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:51.797196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0d0c3c50-592f-4131-8ceb-93715ccb94cb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:51.798521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0d0c3c50-592f-4131-8ceb-93715ccb94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:51.890128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:51.902937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 670/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:52.178381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:52.179935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:52.289433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293a4f6-581f-47c5-8393-3fdc495c3284 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:52.327300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:52.365551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:52.366159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:52.366433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:52.366698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:52.368288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:52.481331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:52.482838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caac3f-9e38-4868-aebd-f4a9a3dfc274 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:52.504583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 673/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:55.162370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:55.163013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:55.163013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:55.164248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 671/1344] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:55.169616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681c5b-e9d9-42d1-b1e4-3014cee1c97a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:55.170031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681c5b-e9d9-42d1-b1e4-3014cee1c97a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:55.170238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681c5b-e9d9-42d1-b1e4-3014cee1c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:55.238983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-89681c5b-e9d9-42d1-b1e4-3014cee1c97a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:55.240209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-89681c5b-e9d9-42d1-b1e4-3014cee1c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:55.259197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:55.340821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 674/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:41:55.620309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:41:55.621946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:55.731670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39699a-dc5c-48f0-9e86-562808c525f3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:41:55.807314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:41:55.807908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:55.808183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:55.808449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:55.810054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:55.857384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:55.928531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:41:55.930099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a01b-df3c-42ca-b89c-d10f612e2a32 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:41:55.950640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 672/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:41:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:41:59.762674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:59.763209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:59.763209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:59.764597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 675/1347] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:41:59.770256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437bc2-ad99-45fc-b46a-324bbed71163 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:41:59.770726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437bc2-ad99-45fc-b46a-324bbed71163 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:41:59.770851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437bc2-ad99-45fc-b46a-324bbed71163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:41:59.843603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-97437bc2-ad99-45fc-b46a-324bbed71163 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:41:59.845048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-97437bc2-ad99-45fc-b46a-324bbed71163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:41:59.948447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:41:59.953021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 673/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:00.236701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:00.238288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:00.350515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dca1-6c02-453c-8562-29b741cd216c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:00.404413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:00.441224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:00.441838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:00.442089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:00.442355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:00.443947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:00.571576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:00.573069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43c97-1b44-466c-84d0-ca5430e33e09 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:00.592016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 676/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:05.466323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb0df-514d-4a52-9e05-4aa59907a117 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:05.467298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb0df-514d-4a52-9e05-4aa59907a117 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:05.470916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb0df-514d-4a52-9e05-4aa59907a117 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:05.471057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 674/1350] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:42:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:05.476379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a72d-3589-43cc-8c92-8a67f70912bf None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:05.477261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a72d-3589-43cc-8c92-8a67f70912bf None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:05.477731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a72d-3589-43cc-8c92-8a67f70912bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:05.628466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3fa3a72d-3589-43cc-8c92-8a67f70912bf None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:05.629888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3fa3a72d-3589-43cc-8c92-8a67f70912bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:05.666285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:05.764817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 677/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:42:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:09.732712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01d19-98c8-4b78-82e1-c68b2eda2236 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:09.733243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01d19-98c8-4b78-82e1-c68b2eda2236 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:09.733762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01d19-98c8-4b78-82e1-c68b2eda2236 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:09.735295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 675/1352] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:09.740999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9555d-c2cf-4a4e-82bc-54ca53626454 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:09.741455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9555d-c2cf-4a4e-82bc-54ca53626454 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:09.741767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9555d-c2cf-4a4e-82bc-54ca53626454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:09.817715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e5c9555d-c2cf-4a4e-82bc-54ca53626454 None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:09.818996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e5c9555d-c2cf-4a4e-82bc-54ca53626454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:09.890268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:09.928937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 678/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:42:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:11.337280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feaf9-5750-485a-8922-fb84dcb240f2 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:11.337847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feaf9-5750-485a-8922-fb84dcb240f2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:11.337847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feaf9-5750-485a-8922-fb84dcb240f2 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:11.339094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 676/1354] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:11.344528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cfc1-ad06-4489-919f-0b2a0c526122 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:11.345100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cfc1-ad06-4489-919f-0b2a0c526122 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:11.345451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cfc1-ad06-4489-919f-0b2a0c526122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:11.424760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-de65cfc1-ad06-4489-919f-0b2a0c526122 None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:11.426044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-de65cfc1-ad06-4489-919f-0b2a0c526122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:11.538538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 679/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:42:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:15.048201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af340-e53d-48b9-9891-06fe8ffcbb2d None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:15.048753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af340-e53d-48b9-9891-06fe8ffcbb2d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:15.048753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af340-e53d-48b9-9891-06fe8ffcbb2d None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:15.050084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 677/1356] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:15.055625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081efa-d77e-4092-92fd-75e614f39cc6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:15.056058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081efa-d77e-4092-92fd-75e614f39cc6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:15.056176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081efa-d77e-4092-92fd-75e614f39cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:15.107693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:15.157525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f7081efa-d77e-4092-92fd-75e614f39cc6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:15.158687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f7081efa-d77e-4092-92fd-75e614f39cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:15.272897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 680/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:15.573801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:15.574026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:15.574495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:15.575796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 678/1358] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 11:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:15.583013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33bcf-7557-4ba1-bee8-78719f416b2b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:15.583670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33bcf-7557-4ba1-bee8-78719f416b2b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:15.584047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33bcf-7557-4ba1-bee8-78719f416b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:15.668617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d3d33bcf-7557-4ba1-bee8-78719f416b2b None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:15.669992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d3d33bcf-7557-4ba1-bee8-78719f416b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:15.720788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:15.801136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 681/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 11:42:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:15.809090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:15.810703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:15.967279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8339a-5db9-4d6f-a8c7-989a802db384 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:16.050169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:16.095435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:16.096048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:16.096326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:16.096596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:16.098215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:16.189837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:16.191456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a13c4-df13-438d-97eb-4dce133b96f5 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:16.209873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 679/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:42:18.296469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:18.297228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:18.297228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:18.301012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 682/1361] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:42:18.304167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe950d-712c-4e29-bca4-5171ba85285e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:18.304692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe950d-712c-4e29-bca4-5171ba85285e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:18.304692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe950d-712c-4e29-bca4-5171ba85285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:18.373966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-eabe950d-712c-4e29-bca4-5171ba85285e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:18.375265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-eabe950d-712c-4e29-bca4-5171ba85285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:18.425275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:18.497691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 680/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:18.797281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:18.799114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:18.957641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a0d95-8f30-4941-9a36-4fdef6cb9b36 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:18.968048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:19.081923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:19.082534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:19.082806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:19.083055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:19.085006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:19.195685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:19.197478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336667-8514-46ff-833a-b7e97551b808 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:19.217619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 683/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:21.466219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a270ab-5b73-45eb-ad7b-bdc062654d47 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:21.466816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a270ab-5b73-45eb-ad7b-bdc062654d47 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:21.466816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a270ab-5b73-45eb-ad7b-bdc062654d47 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:21.468076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 681/1364] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:21.473739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9c732-20c2-413e-b7c4-e9fcce446abd None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:21.474194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9c732-20c2-413e-b7c4-e9fcce446abd None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:21.474276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9c732-20c2-413e-b7c4-e9fcce446abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:21.495144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:21.555973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1fb9c732-20c2-413e-b7c4-e9fcce446abd None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:21.557210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1fb9c732-20c2-413e-b7c4-e9fcce446abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:21.663293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 684/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:21.948778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:21.949215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:21.949579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:21.950991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 682/1366] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 11:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:21.957267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd272f5-99e2-4eeb-b210-3b6289e08a88 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:21.957648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd272f5-99e2-4eeb-b210-3b6289e08a88 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:21.957984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd272f5-99e2-4eeb-b210-3b6289e08a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:22.047190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6bd272f5-99e2-4eeb-b210-3b6289e08a88 None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:22.048587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6bd272f5-99e2-4eeb-b210-3b6289e08a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:22.086170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:22.172479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 685/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:22.181621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:22.183157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:22.347267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2316a-ffff-4da9-9fd0-aca99bc71181 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:22.369869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:22.471260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:22.471990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:22.472387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:22.472756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:22.474551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:22.574001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:22.575806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad7fb5-b674-4eaf-8ab1-acaf86a6dcdc service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:22.598651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 683/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:23.108956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8170-5c5f-4910-b897-28ff79a376cb None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:23.109632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8170-5c5f-4910-b897-28ff79a376cb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:23.109632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8170-5c5f-4910-b897-28ff79a376cb None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:23.111158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 686/1369] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:23.116288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0ea2f-b8b0-4752-b84d-1bdb9d4beb00 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:23.116570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0ea2f-b8b0-4752-b84d-1bdb9d4beb00 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:23.116845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0ea2f-b8b0-4752-b84d-1bdb9d4beb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:23.152172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:23.192354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d5e0ea2f-b8b0-4752-b84d-1bdb9d4beb00 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:23.193782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d5e0ea2f-b8b0-4752-b84d-1bdb9d4beb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:23.297396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 684/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:23.881279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:23.881279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:23.881279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:23.881279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 687/1371] 10.222.0.13 () {54 vars in 964 bytes} [Tue Aug 30 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:23.885473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cc68-a41f-41c6-9049-f4864fd08c39 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:23.886026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cc68-a41f-41c6-9049-f4864fd08c39 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:23.886177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cc68-a41f-41c6-9049-f4864fd08c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:23.967651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0f16cc68-a41f-41c6-9049-f4864fd08c39 None None] MFA Rules not processed for user `aea417bef9414609b3c79bbf2cc2ced2`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:23.969270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0f16cc68-a41f-41c6-9049-f4864fd08c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:24.023875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:24.059230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 685/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Aug 30 11:42:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:24.066963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:24.068616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:24.177444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef2f28-324f-4c04-80a2-3f8ed866b824 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:24.219606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:24.260056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:24.260820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:24.261252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:24.261628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:24.263333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:24.388921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:24.391193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8fa0-4f12-4671-a053-196a3877e411 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:24.417211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 688/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:24.582954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:24.583236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:24.583642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:24.585300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 686/1374] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:24.595495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657a57-e670-4fcb-a708-e15041f9139b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:24.597630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657a57-e670-4fcb-a708-e15041f9139b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:24.598567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657a57-e670-4fcb-a708-e15041f9139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:24.680067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-55657a57-e670-4fcb-a708-e15041f9139b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:24.681377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-55657a57-e670-4fcb-a708-e15041f9139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:24.716113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:24.802114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 689/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:25.094762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:25.096285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:25.256059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39106c-783e-42fc-8a86-f6e118e940a4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:25.310883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:25.373078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:25.373617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:25.373897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:25.374168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:25.375802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:25.475015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:25.476638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb13e-e22f-41ec-ad8a-623aaf31b5fa service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:25.495147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 687/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:27.462863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:27.463367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:27.463463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:27.465388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 690/1377] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:27.471008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6a6b-b294-4cce-90de-59196e207e9a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:27.471437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6a6b-b294-4cce-90de-59196e207e9a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:27.471531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6a6b-b294-4cce-90de-59196e207e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:27.538332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-987a6a6b-b294-4cce-90de-59196e207e9a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:27.539510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-987a6a6b-b294-4cce-90de-59196e207e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:27.546228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:27.636618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 688/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:27.936943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:27.938410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:28.105005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744958da-89b6-44c3-9ee3-b20261582b36 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:28.109060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:28.226065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:28.226673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:28.226953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:28.227230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:28.228809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:28.322114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:28.323710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06b6a-62e9-4898-be5e-a021b7cad07e service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:28.342747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 691/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:30.568082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:30.568668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:30.568668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:30.570197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 689/1380] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:30.575351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bcfe-431b-4c15-a2fa-665f05e813d4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:30.575796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bcfe-431b-4c15-a2fa-665f05e813d4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:30.575899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bcfe-431b-4c15-a2fa-665f05e813d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:30.588251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:30.650643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-cd23bcfe-431b-4c15-a2fa-665f05e813d4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:30.651890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cd23bcfe-431b-4c15-a2fa-665f05e813d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:30.775583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 692/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:31.068227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:31.069767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:31.217836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:31.230338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61f8d-2606-477c-971a-a527bcc020cc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:31.360880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:31.361451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:31.361731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:31.362004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:31.363591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:31.460758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:31.462429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7f59-95df-4d40-89ed-1bebe4198558 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:31.473759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:31.483143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 690/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:33.574550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:33.575088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:33.575088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:33.576453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 693/1383] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:33.583293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414bee3-c999-4307-aab7-f79adeda7c0f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:33.583828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414bee3-c999-4307-aab7-f79adeda7c0f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:33.583828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414bee3-c999-4307-aab7-f79adeda7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:33.661980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7414bee3-c999-4307-aab7-f79adeda7c0f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:33.663252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7414bee3-c999-4307-aab7-f79adeda7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:33.768195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 691/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:34.052476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:34.054017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:34.150355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:34.217661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c373c4-c1e8-459a-b5c6-bf3c1ad7ba4c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:34.363870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:34.364566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:34.364914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:34.365290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:34.367302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:34.428835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:34.474716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:34.476326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd2c47-3369-4f80-92a3-cd672d01ebbd service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:34.498760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 694/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:42:36.429436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:36.430176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:36.430176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:36.431347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 692/1386] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:36.437444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc9cf-70f1-4da3-aa08-faa1cf636c59 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:36.437916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc9cf-70f1-4da3-aa08-faa1cf636c59 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:36.438194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc9cf-70f1-4da3-aa08-faa1cf636c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:36.518048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5b1fc9cf-70f1-4da3-aa08-faa1cf636c59 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:36.519204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5b1fc9cf-70f1-4da3-aa08-faa1cf636c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:36.637402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 695/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:36.923339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:36.925386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:37.014523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:37.089739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dee72-e7ae-4adb-b510-d0d8baa129ec None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:37.248594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:37.249782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:37.250236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:37.251041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:37.254228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:37.321169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:37.379940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:37.381588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70aad6d-3195-42e8-a8f3-c7fc8ca4b454 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:37.401466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 693/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:39.417454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:39.418450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:39.418450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:39.419464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 696/1389] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:42:39.425269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d788-2872-4bd2-bae2-2302cc7aea12 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:39.425799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d788-2872-4bd2-bae2-2302cc7aea12 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:39.425799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d788-2872-4bd2-bae2-2302cc7aea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:39.503815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f201d788-2872-4bd2-bae2-2302cc7aea12 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:39.506030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f201d788-2872-4bd2-bae2-2302cc7aea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:39.637332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 694/1390] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:39.926150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:39.927764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:39.960957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:40.082008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b90e-1f21-4221-98fd-af6a514690c6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:40.182197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:40.194114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:40.194731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:40.195007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:40.195274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:40.196870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:40.289258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:40.290907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7f41-9268-4d3e-bbf2-5565b1e9b004 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:40.309949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 697/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:41.836818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35d8a-d8bb-497f-b3fa-cb8b75e831d5 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:41.837453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35d8a-d8bb-497f-b3fa-cb8b75e831d5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:41.837453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35d8a-d8bb-497f-b3fa-cb8b75e831d5 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:41.838740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 695/1392] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:41.844269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13ae3-6b51-406f-9c51-0ef5508e8a4d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:41.844747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13ae3-6b51-406f-9c51-0ef5508e8a4d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:41.844857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13ae3-6b51-406f-9c51-0ef5508e8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:41.915092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-86c13ae3-6b51-406f-9c51-0ef5508e8a4d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:41.916297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-86c13ae3-6b51-406f-9c51-0ef5508e8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:41.976486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:42.015799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 698/1393] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:42.209101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267b22-20f3-43f5-8868-e21e6a59f87a None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.209323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267b22-20f3-43f5-8868-e21e6a59f87a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.209573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267b22-20f3-43f5-8868-e21e6a59f87a None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.211080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 696/1394] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:42.216191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.216619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.216895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.285606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:42.286815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:42.319193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daebc0-e31a-4aa6-84a8-9187f1e6369e None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.319464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daebc0-e31a-4aa6-84a8-9187f1e6369e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.319750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daebc0-e31a-4aa6-84a8-9187f1e6369e None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.321113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 697/1395] 10.222.0.13 () {54 vars in 967 bytes} [Tue Aug 30 11:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:42:42.328285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.328640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.328997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.345331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:42.390958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 699/1396] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:42.405911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] MFA Rules not processed for user `bab5524ecd44403bb82fd4d6433fb002`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:42.407437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:42.485552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 698/1397] 10.222.0.13 () {58 vars in 1064 bytes} [Tue Aug 30 11:42:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:42.494462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:42.495878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:42.546533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:42.593083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459ef9-e256-49d5-a882-8c70efdf0d1e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:42.670827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:42.671804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.672262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.672386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.673293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:42.673989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:42.674515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:42.781184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:42.787561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:42.789087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfd39f-a43c-4ded-9623-4b7da3938949 service glance] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:42.794608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:42.797500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0142ad-3c47-464b-8728-163788d2dc4f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:42.812747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 700/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:42.929163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:42.930466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:42.931038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:42.931507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:42.933472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:43.031361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:43.033019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926d54-4763-4f20-914b-a83e4300506e service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:43.044929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:43.056697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 699/1399] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:43.560333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e9c0-818e-4764-ae36-bac6886029d8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:43.560834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e9c0-818e-4764-ae36-bac6886029d8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:43.560834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e9c0-818e-4764-ae36-bac6886029d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:43.630104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7a76e9c0-818e-4764-ae36-bac6886029d8 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:43.631311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7a76e9c0-818e-4764-ae36-bac6886029d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:43.719638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 701/1400] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:42:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:43.762511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:43.762867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:43.763205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:43.764673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 700/1401] 10.222.0.13 () {54 vars in 943 bytes} [Tue Aug 30 11:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:43.771535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720756-3e59-410e-847a-f322a07bb094 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:43.771828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720756-3e59-410e-847a-f322a07bb094 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:43.772101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720756-3e59-410e-847a-f322a07bb094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:43.848662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-70720756-3e59-410e-847a-f322a07bb094 None None] MFA Rules not processed for user `6e6a60e442924d9e92910b778414a60e`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:43.849899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-70720756-3e59-410e-847a-f322a07bb094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:43.871859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:43.958316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 702/1402] 10.222.0.13 () {58 vars in 1040 bytes} [Tue Aug 30 11:42:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:42:43.967701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:43.969337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:44.116195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1a61d-0447-4fb4-a865-efa8a3d4466f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:44.199931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:44.225175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:44.225766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:44.226056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:44.226326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:44.227954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:44.312014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:44.313674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f77e9-6252-4515-87ef-70b856dacd9f service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:44.321970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 701/1403] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:42:45.002215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:45.002887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:45.002887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:45.004642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 703/1404] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:45.009799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d97ed-b35d-4794-b0eb-8251573b37a7 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:45.010254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d97ed-b35d-4794-b0eb-8251573b37a7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:45.010346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d97ed-b35d-4794-b0eb-8251573b37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:45.083719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a76d97ed-b35d-4794-b0eb-8251573b37a7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:45.084935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a76d97ed-b35d-4794-b0eb-8251573b37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:45.158229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:45.192938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 702/1405] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:45.482649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:45.485343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:45.639166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:45.648106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7bd71-c45b-4434-8dc1-3caffd278e15 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:45.772581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:45.773251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:45.773593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:45.773931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:45.775699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:45.879698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:45.881410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850be1-341b-403c-963c-46e9425ccf7b service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:45.898477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:45.913170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 704/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:47.838044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:47.838636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:47.838636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:47.842847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 703/1407] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:42:47.845870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508ffc-2227-4eb2-a0a4-8d239cf2b4c4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:47.846372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508ffc-2227-4eb2-a0a4-8d239cf2b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:47.846372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508ffc-2227-4eb2-a0a4-8d239cf2b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:47.923856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4a508ffc-2227-4eb2-a0a4-8d239cf2b4c4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:42:47.925246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4a508ffc-2227-4eb2-a0a4-8d239cf2b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:48.035363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 705/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:42:48.327045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:42:48.329093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:48.514658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda8d5-f33f-4ced-945b-c765eaeb3731 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:42:48.576927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:48.646935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:42:48.648008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:42:48.648288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:42:48.648560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:42:48.650248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:42:48.752461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:42:48.754125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78137bec-3ee2-46ea-aa3b-7f3ccdc95d33 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:42:48.782286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 704/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:42:58.033561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=66 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:42:58.773617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=74 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:06.152926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec1cb-a2f4-430b-81b7-73fbfc328cc5 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:06.153555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec1cb-a2f4-430b-81b7-73fbfc328cc5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:06.153555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec1cb-a2f4-430b-81b7-73fbfc328cc5 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:06.154842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 706/1410] 10.222.0.13 () {54 vars in 918 bytes} [Tue Aug 30 11:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:06.163643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e7adc-ca8d-4846-820e-6d96c8768298 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:06.164110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e7adc-ca8d-4846-820e-6d96c8768298 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:06.164211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e7adc-ca8d-4846-820e-6d96c8768298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:06.247155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-928e7adc-ca8d-4846-820e-6d96c8768298 None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:06.248351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-928e7adc-ca8d-4846-820e-6d96c8768298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:06.362798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 705/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Aug 30 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:06.382260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95af4-ebb3-41a7-abd5-605321bfefdf None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:06.382618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95af4-ebb3-41a7-abd5-605321bfefdf None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:06.382872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95af4-ebb3-41a7-abd5-605321bfefdf None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:06.384947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 707/1412] 10.222.0.13 () {54 vars in 918 bytes} [Tue Aug 30 11:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:06.390996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47add2-9842-44a6-bfe7-e2020b4db85c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:06.391284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47add2-9842-44a6-bfe7-e2020b4db85c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:06.391559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47add2-9842-44a6-bfe7-e2020b4db85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:06.466639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:06.470553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4c47add2-9842-44a6-bfe7-e2020b4db85c None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:06.472554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4c47add2-9842-44a6-bfe7-e2020b4db85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:06.605481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 706/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Aug 30 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:09.052903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:09.053518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:09.053518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:09.055543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:09.063299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4554b-8e91-4dd2-9780-a3161cee7fda None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:09.063709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4554b-8e91-4dd2-9780-a3161cee7fda None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:09.063823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4554b-8e91-4dd2-9780-a3161cee7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:09.136359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b8c4554b-8e91-4dd2-9780-a3161cee7fda None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:09.137587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b8c4554b-8e91-4dd2-9780-a3161cee7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:09.204480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:09.257340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:09.539446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:09.541155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:09.698475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92122c-5b9b-4dca-9089-7eb17f78b8cb None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:09.773490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:09.815096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:09.815728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:09.816006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:09.816274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:09.817909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:09.916070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:09.917722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9e2e-1e4e-4b41-b24f-2975d92f0437 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:09.937572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 709/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:10.822628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:10.823475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:10.823475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:10.825638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:10.833134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9add4-dfa3-4de6-92b9-0c38cf0487ea None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:10.833551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9add4-dfa3-4de6-92b9-0c38cf0487ea None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:10.833667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9add4-dfa3-4de6-92b9-0c38cf0487ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:10.920393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b6b9add4-dfa3-4de6-92b9-0c38cf0487ea None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:10.921672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b6b9add4-dfa3-4de6-92b9-0c38cf0487ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:10.949037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:11.021886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:11.168342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:11.170680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:11.339936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67692e3d-2cda-4bca-96a1-bb6de5fdfe96 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:11.393678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:11.473012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:11.473579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:11.473858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:11.474125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:11.475744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:11.568599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:11.570243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c25e-5d0d-4dea-9708-98fd0d1969d8 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:11.589180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 709/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:12.492680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:12.493148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:12.493240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:12.494637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:12.500902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acc1f-c4e6-4cb1-86a4-ff3a0faa2f07 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:12.501370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acc1f-c4e6-4cb1-86a4-ff3a0faa2f07 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:12.501477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acc1f-c4e6-4cb1-86a4-ff3a0faa2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:12.563335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:12.595013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7b4acc1f-c4e6-4cb1-86a4-ff3a0faa2f07 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:12.596204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7b4acc1f-c4e6-4cb1-86a4-ff3a0faa2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:12.711056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:12.872420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:12.874296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:13.033887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120d9e-ce25-4f99-b723-2f739e3a0ceb None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:13.046768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:13.155174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192361b-7dee-4209-b19d-460758573259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:13.155700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192361b-7dee-4209-b19d-460758573259 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:13.155980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192361b-7dee-4209-b19d-460758573259 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:13.156248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192361b-7dee-4209-b19d-460758573259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:13.157908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2192361b-7dee-4209-b19d-460758573259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:13.252788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192361b-7dee-4209-b19d-460758573259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:13.254716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192361b-7dee-4209-b19d-460758573259 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:13.273201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 712/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:14.142621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:14.143196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:14.143196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:14.144518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:14.149805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456345-3911-48eb-8509-d04c762cec1a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:14.150239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456345-3911-48eb-8509-d04c762cec1a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:14.150346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456345-3911-48eb-8509-d04c762cec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:14.174843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:14.235672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-79456345-3911-48eb-8509-d04c762cec1a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:14.236916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-79456345-3911-48eb-8509-d04c762cec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:14.344749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:14.495725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:14.497276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:14.623781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:14.660997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562802-5bd2-4941-ae9e-e61f058fc7db None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:14.784862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:14.785427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:14.785703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:14.785968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:14.787541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:14.879381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:14.893968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:14.895595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba922cf-e596-4529-b59e-10dbb6d62f71 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:14.914461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 712/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:15.791964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:15.792832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:15.792832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:15.795193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:15.802313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e64553-1508-4542-aa77-8d30726852f6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:15.802732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e64553-1508-4542-aa77-8d30726852f6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:15.802841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e64553-1508-4542-aa77-8d30726852f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:15.888332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b0e64553-1508-4542-aa77-8d30726852f6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:15.889701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b0e64553-1508-4542-aa77-8d30726852f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:16.001812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:16.156498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:16.158179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:16.248591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:16.310870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7af85-368a-451a-983e-7f086b58adb9 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:16.435193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:16.435807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:16.436274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:16.436565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:16.438212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:16.488290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:16.533462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:16.535106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286005fa-3d72-46f6-9539-0297040f71d7 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:16.553922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 715/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:17.380632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:17.381614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:17.381614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:17.383461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:17.389446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894067-a2cb-4e20-91c8-569ef781feb9 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:17.389878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894067-a2cb-4e20-91c8-569ef781feb9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:17.389997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894067-a2cb-4e20-91c8-569ef781feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:17.479328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-58894067-a2cb-4e20-91c8-569ef781feb9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:17.480550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-58894067-a2cb-4e20-91c8-569ef781feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:17.584923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:17.741091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:17.742537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:17.797833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:17.900218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf6af5-fdee-492f-981d-d3bc2516a54a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:18.023289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:18.024121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:18.024549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:18.025142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:18.027603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:18.039385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:18.137616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:18.140296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894cb8d-0bd8-4a09-af9e-f69362e850fb service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:18.159394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 715/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:18.962642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:18.963538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:18.963538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:18.965768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:18.971602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bf0a-de51-4650-b257-68ecafda6340 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:18.972370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bf0a-de51-4650-b257-68ecafda6340 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:18.972489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bf0a-de51-4650-b257-68ecafda6340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:19.058224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9e37bf0a-de51-4650-b257-68ecafda6340 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:19.058224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9e37bf0a-de51-4650-b257-68ecafda6340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:19.131901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:19.164583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:19.316224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:19.318964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:19.346997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:19.485149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39160-2491-42a7-a729-2d1866f084c3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:19.586567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:19.613426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:19.614043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:19.614321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:19.614595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:19.616204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:19.727427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:19.729038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723cd9f-f5cc-43e8-9e13-19e5a29dc987 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:19.749916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 718/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:20.559071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:20.559692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:20.559692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:20.561006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:20.567151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5475ce-b393-45a5-b8eb-fb0e833467c4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:20.567911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5475ce-b393-45a5-b8eb-fb0e833467c4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:20.568092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5475ce-b393-45a5-b8eb-fb0e833467c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:20.654479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1a5475ce-b393-45a5-b8eb-fb0e833467c4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:20.655814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1a5475ce-b393-45a5-b8eb-fb0e833467c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:20.703250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:20.765520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:20.918197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:20.921117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:21.090548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e106b9a-daf7-44de-87fe-9a88465e58cd None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:21.158548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:21.228029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:21.228640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:21.228915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:21.229240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:21.230861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:21.325629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:21.327350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715d3a9-74ee-46bb-b229-1c4cd75a566b service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:21.346095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 718/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:22.142280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:22.143182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:22.143182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:22.145308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:22.152985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982df18-f947-4ade-81f7-1ffb5716803e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:22.153454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982df18-f947-4ade-81f7-1ffb5716803e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:22.153560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982df18-f947-4ade-81f7-1ffb5716803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:22.230807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a982df18-f947-4ade-81f7-1ffb5716803e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:22.231994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a982df18-f947-4ade-81f7-1ffb5716803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:22.234061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:22.332896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:22.485368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:22.486967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:22.644529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805ff6-9a27-448a-ac87-e8e2cf051db9 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:22.672055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:22.765268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:22.765801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:22.766081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:22.766354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:22.767960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:22.864092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:22.865743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aea3d-d9f7-4255-acc1-3091f70104e9 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:22.884623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 721/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:24.677557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:24.678097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:24.678097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:24.679455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:24.686016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04c10-f2b5-4352-8ae6-b0995c87686e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:24.686886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04c10-f2b5-4352-8ae6-b0995c87686e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:24.687169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04c10-f2b5-4352-8ae6-b0995c87686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:24.732476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:24.764528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5eb04c10-f2b5-4352-8ae6-b0995c87686e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:24.765689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5eb04c10-f2b5-4352-8ae6-b0995c87686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:24.868133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:25.149836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:25.151383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:25.262399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6937e1-c8c8-4a80-9fa5-a2a716a4339b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:25.296984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:25.344951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:25.345593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:25.345871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:25.346115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:25.347719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:25.466381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:25.468099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e5343-3965-46d0-a2d3-d482d5ae3095 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:25.486645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 721/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:43:27.616648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:27.617257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:27.617257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:27.618569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:27.624687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65818-c6ae-4e2a-8220-5bfae484648e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:27.625191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65818-c6ae-4e2a-8220-5bfae484648e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:27.625295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65818-c6ae-4e2a-8220-5bfae484648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:27.692221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f1f65818-c6ae-4e2a-8220-5bfae484648e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:27.693442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f1f65818-c6ae-4e2a-8220-5bfae484648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:27.707089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:27.797194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:28.079433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:28.081333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:28.187957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298bb12-292c-49e2-bd02-f2d9d438260c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:28.200138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:28.267883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:28.268478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:28.268750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:28.269014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:28.270680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:28.385995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:28.387349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238cfd6-68ff-45e9-a124-1b2d7cdce1d3 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:28.405491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 724/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:43:30.629750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:30.630334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:30.630334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:30.631686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:30.637986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66e975-3402-433b-b2d4-2dc36a4a4222 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:30.638432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66e975-3402-433b-b2d4-2dc36a4a4222 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:30.638560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66e975-3402-433b-b2d4-2dc36a4a4222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:30.694661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:30.713298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-af66e975-3402-433b-b2d4-2dc36a4a4222 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:30.714521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-af66e975-3402-433b-b2d4-2dc36a4a4222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:30.825397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:31.126043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:31.128504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:31.249827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf129c-3c78-425a-a03e-81c4de91a8d5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:31.292893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:31.333670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:31.334292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:31.334563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:31.334852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:31.336483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:31.450261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:31.451671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea59d-7f58-47cd-b3eb-041a97c0fc64 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:31.469803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 724/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:33.485969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:33.486572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:33.486572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:33.487877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:33.494205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490def1-1998-46a5-a660-7d62ba71a2f6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:33.494686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490def1-1998-46a5-a660-7d62ba71a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:33.494793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490def1-1998-46a5-a660-7d62ba71a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:33.566248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a490def1-1998-46a5-a660-7d62ba71a2f6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:33.567443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a490def1-1998-46a5-a660-7d62ba71a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:33.589256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:33.679441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:33.963762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:33.966408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:34.099401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148159-680b-4ba5-9e62-fbe0f3bf089a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:34.120534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:34.177605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:34.178204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:34.178477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:34.178746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:34.180343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:34.300576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:34.302038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3fe46-b9a4-44fe-9ce5-8998e1b946e7 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:34.322244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 727/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:36.305573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.306131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.306227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.308211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:36.317615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa65f6-3a77-4bb7-b2eb-32775ee69f29 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.318053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa65f6-3a77-4bb7-b2eb-32775ee69f29 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.318211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa65f6-3a77-4bb7-b2eb-32775ee69f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.388904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.393084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-21aa65f6-3a77-4bb7-b2eb-32775ee69f29 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:36.395863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-21aa65f6-3a77-4bb7-b2eb-32775ee69f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:36.520860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:36.807224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.809593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:36.927632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c94ff-4f8b-491f-a82c-bee67e54bef6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.976044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:37.014530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.015135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.015413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.015682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.017290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:37.140523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.142001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708387b-a518-495f-bf64-7134b80009f6 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.160043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 727/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:39.105738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.106610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.106610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.108404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:39.113930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d03d-917f-4069-aa55-058deedc8407 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.114381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d03d-917f-4069-aa55-058deedc8407 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.114492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d03d-917f-4069-aa55-058deedc8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.182939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ac18d03d-917f-4069-aa55-058deedc8407 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:39.184134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ac18d03d-917f-4069-aa55-058deedc8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:39.215834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:39.300305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:39.593311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:39.595817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:39.719580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca532994-e61c-4f01-ad92-c429c656825d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:39.758122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:39.806391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:39.806999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.807276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.807521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.809183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:39.944915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:39.946461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e5e9-fd1b-424d-9a7a-6af179f5aeb1 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:39.965331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 730/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:42.090125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.090696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.090696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.092111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:42.100813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2470-e9d8-490f-a38c-5d86d4aacb57 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.101571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2470-e9d8-490f-a38c-5d86d4aacb57 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.101753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2470-e9d8-490f-a38c-5d86d4aacb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.173911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-efec2470-e9d8-490f-a38c-5d86d4aacb57 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:42.175111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-efec2470-e9d8-490f-a38c-5d86d4aacb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:42.183508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:42.294761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:42.580034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:42.582951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:42.692171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f99ad8-5213-45b5-91ca-b3c893c1f802 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:42.750875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:42.771431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:42.772039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.772312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.772581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.774233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:42.896214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:42.897732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448642-8271-4c07-8d07-3902cafe1263 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:42.917647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 730/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:44.869433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:44.870009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:44.870009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:44.871363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:44.877731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea8a4a-0e94-4692-96e8-a5078be7fd45 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:44.878165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea8a4a-0e94-4692-96e8-a5078be7fd45 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:44.878274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea8a4a-0e94-4692-96e8-a5078be7fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:44.960138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-47ea8a4a-0e94-4692-96e8-a5078be7fd45 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:44.960798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-47ea8a4a-0e94-4692-96e8-a5078be7fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:45.002146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:45.062643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:45.348088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:45.349667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:45.473638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8721d-38fe-4992-80b3-e764d635a82e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:45.633814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:45.674343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:45.674947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:45.675222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:45.675491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:45.677131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:45.804388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:45.805865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7323681-1fd6-44bc-b3b5-40d8d36a5d55 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:45.826244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 733/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:47.789320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.790160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.790160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.791928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:47.798849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513e52-468a-414e-81ca-815cc0c20408 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.799734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513e52-468a-414e-81ca-815cc0c20408 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.799734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513e52-468a-414e-81ca-815cc0c20408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.883698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d2513e52-468a-414e-81ca-815cc0c20408 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:47.884893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d2513e52-468a-414e-81ca-815cc0c20408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:47.905679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.992807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:48.274555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.277864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:48.393200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbabf0e-474b-49be-b9ec-8e751d9ff5b4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.468152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.478083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.478970 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.479306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.479638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.482072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:48.598231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.599693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d967062-5fbb-4456-89f8-3960e056bc61 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.618460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 733/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:43:50.578720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.579571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.579769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.582392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:43:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:43:50.588799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd37e-496b-4de6-8626-eda1012c595e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.589298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd37e-496b-4de6-8626-eda1012c595e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.589410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd37e-496b-4de6-8626-eda1012c595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.665938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-da6cd37e-496b-4de6-8626-eda1012c595e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:50.667159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-da6cd37e-496b-4de6-8626-eda1012c595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:50.721581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:50.776427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:43:51.061301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.062911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:51.184956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5293c-35c5-45f9-a1ba-01a0bea2f870 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.238040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:51.266121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.266688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.266961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.267227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.268809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:51.387287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:51.388952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fee8fc-2b2c-4851-951e-006cfb93a41e service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:51.411887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 736/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:00.774338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=22 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.409334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=66 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.799199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b4f-8c3a-4be8-97c9-3fb8997069b9 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.800046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b4f-8c3a-4be8-97c9-3fb8997069b9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.800046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b4f-8c3a-4be8-97c9-3fb8997069b9 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.802283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 735/1471] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:10.808746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4ff9d-a030-41e2-bdbf-68b731958782 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.809254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4ff9d-a030-41e2-bdbf-68b731958782 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.809350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4ff9d-a030-41e2-bdbf-68b731958782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.882011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-23c4ff9d-a030-41e2-bdbf-68b731958782 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:10.883214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-23c4ff9d-a030-41e2-bdbf-68b731958782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:10.987760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 737/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:11.284404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.284688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.284952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.286317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 736/1473] 10.222.0.13 () {54 vars in 967 bytes} [Tue Aug 30 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:11.293695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132010e-4669-40ce-9d7a-7ba71fbb5eb5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.294034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132010e-4669-40ce-9d7a-7ba71fbb5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.294420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132010e-4669-40ce-9d7a-7ba71fbb5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.378516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7132010e-4669-40ce-9d7a-7ba71fbb5eb5 None None] MFA Rules not processed for user `bab5524ecd44403bb82fd4d6433fb002`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:11.379725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7132010e-4669-40ce-9d7a-7ba71fbb5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:11.400657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.460947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 738/1474] 10.222.0.13 () {58 vars in 1064 bytes} [Tue Aug 30 11:44:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:11.468759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:11.470489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:11.576927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd14991-aef0-4a70-b812-fb328e79e2ed None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.662812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.663417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.663701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.663952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.665557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:11.727445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.784550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.786149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315035-4202-4cc5-a0d7-b83ab0ed21cc service glance] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.805775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 737/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:13.779348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.780148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.780148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.782385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 739/1476] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:13.788659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208998c-32d9-4997-b7e3-ae933b7b6c5f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.789397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208998c-32d9-4997-b7e3-ae933b7b6c5f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.789569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208998c-32d9-4997-b7e3-ae933b7b6c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.867498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6208998c-32d9-4997-b7e3-ae933b7b6c5f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:13.868719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6208998c-32d9-4997-b7e3-ae933b7b6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:13.976821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 738/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:14.257614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.260077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:14.402736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c599e-54b6-40be-86d6-6da300afcdb6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.454144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.502369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.502968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.503240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.503502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.504142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.505935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:44:14.505935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:44:14.505935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:44:14.507189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db57d-d377-447f-85b3-cf711451649e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.526154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 740/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:44:16.453060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d660f-1f37-4648-9057-feae75574c0b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.453621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d660f-1f37-4648-9057-feae75574c0b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.453621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d660f-1f37-4648-9057-feae75574c0b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.454852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 739/1479] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:16.460579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea5bc-16bc-4ce1-a602-27b9fad3789a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.461081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea5bc-16bc-4ce1-a602-27b9fad3789a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.461206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea5bc-16bc-4ce1-a602-27b9fad3789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.529366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d7aea5bc-16bc-4ce1-a602-27b9fad3789a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:16.530560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d7aea5bc-16bc-4ce1-a602-27b9fad3789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:16.635163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 741/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:16.928895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d660f-1f37-4648-9057-feae75574c0b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.931290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-022d660f-1f37-4648-9057-feae75574c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:16.944332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.098754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d660f-1f37-4648-9057-feae75574c0b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:17.181152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.218075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:17.218649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.218922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.219156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.220742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:17.312737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:17.314376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1016d2-2351-416e-8183-f476374572aa service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:17.333981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 740/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:19.458007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.458579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.458579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.460305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 742/1482] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:19.468353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55598-6990-4ab5-8920-bcb22181cdc1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.468783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55598-6990-4ab5-8920-bcb22181cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.468878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55598-6990-4ab5-8920-bcb22181cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.539384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7bc55598-6990-4ab5-8920-bcb22181cdc1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:19.540589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7bc55598-6990-4ab5-8920-bcb22181cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:19.589401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.641806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 741/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:19.928830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.931328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:19.957121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:20.050302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba043a9-5f84-4a8d-bf58-35bb075092ed None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:20.137208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:20.137875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:20.138147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:20.138411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:20.140004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:20.216693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:20.254064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:20.255512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add997ba-8e09-4452-8355-2312fa5d69f6 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:20.274726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 743/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:22.271539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.272137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.272137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.273357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 742/1485] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:22.280207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca945-1d8b-4020-b812-c5de67eb7f62 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.280881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca945-1d8b-4020-b812-c5de67eb7f62 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.281000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca945-1d8b-4020-b812-c5de67eb7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.361758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e25ca945-1d8b-4020-b812-c5de67eb7f62 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:22.362962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e25ca945-1d8b-4020-b812-c5de67eb7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:22.476147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 744/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:22.766553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.768092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:22.883244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3810e-8f60-46e8-94e0-74c6b380b5b6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:22.960740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:22.962390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:22.963021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.963286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.963635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.965928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:23.079540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.081365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d9a7-ff97-4793-a1c6-040bb3dba411 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.099502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 743/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:25.077359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.078263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.078263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.080786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 745/1488] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:25.088883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43f238-eaa3-43cc-9e4c-17ec0150a8b2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.089373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43f238-eaa3-43cc-9e4c-17ec0150a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.089478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43f238-eaa3-43cc-9e4c-17ec0150a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.159426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7d43f238-eaa3-43cc-9e4c-17ec0150a8b2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:25.160636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7d43f238-eaa3-43cc-9e4c-17ec0150a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:25.215553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.279366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 744/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:44:25.566654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.569265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:25.611254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.691398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9bf9d-bd99-4128-808e-616e49bdc177 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.774577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.775252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.775583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.775911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.778706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:25.870896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.909611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.911073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d2ffe-5f89-4165-ab69-07c12c0940cf service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.930795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 746/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:28.065770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.066366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.066366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.067663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 745/1491] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 11:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:28.074056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976a55-8140-4bf6-890e-2e8a69ca0948 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.074511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976a55-8140-4bf6-890e-2e8a69ca0948 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.075031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976a55-8140-4bf6-890e-2e8a69ca0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.146876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-69976a55-8140-4bf6-890e-2e8a69ca0948 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:28.148089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-69976a55-8140-4bf6-890e-2e8a69ca0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:28.259221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 747/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:44:28.545086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.546676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:28.662472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b14d96-8008-4726-9b13-4a9c9fa96310 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.738557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.739208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.739480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.739742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.741443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:28.750887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.852580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.854036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df87f40-f991-4b3f-b7d3-d6200e2ec087 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.872370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 746/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:44:38.257130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=82 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.869815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=50 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.669018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.669924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.670081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.755159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:43.756284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:43.854513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 748/1494] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:45:43.863742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.864271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.864398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.951472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:43.952734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.078385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 747/1495] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:45:44.083632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.084887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.096845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8885b27-709f-4449-8240-b7957dd0516f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.163672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.201811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.202423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.202702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.202970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.203614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:44.203914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.205281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:44.205281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:45:44.205281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:45:44.206177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.218290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 749/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:44.226739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.237277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e857f-3566-44f9-b9dc-bc3716a0cb03 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.303228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.338690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.339215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.339489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.339734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.340427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.342277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:44.342277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:45:44.342277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:45:44.343495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.406946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 748/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:45:44 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:44.411457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.413103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.447763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77a47-f786-4876-a154-d26988b0e096 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.547911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.548522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.548804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.549091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.549729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.550756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:44.550756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:45:44.550756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:45:44.551941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.597657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 750/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:44 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:44.601766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.603301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.673336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186746-e560-472b-a028-020a6ce7615d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.760024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.776228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.777116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.777471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.777920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.779066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.780638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:44.780638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:45:44.780638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:45:44.782068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.799192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 749/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:44.803436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.804989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.816520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce9c-a353-46be-b243-b0545a6edaca admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.842698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.915369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.915906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.916188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.916465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.917166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.918222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:44.918222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:45:44.918222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:45:44.919165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff469b2e-9973-41aa-8491-ea2a9d0c7b50 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.931666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 751/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:44.936444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.938085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.973526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0690f01-09b4-420a-a6aa-fdf54059e2ed admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.070782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.071466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.071744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.072013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] PATH_INFO: `/v3/projects/00bf76de4afd419c85da910aad92d5b1/users/b7cf9bfe13b44c0a9d5d5272e74d0ac9/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.094889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bf76de4afd419c85da910aad92d5b1, user_id=b7cf9bfe13b44c0a9d5d5272e74d0ac9, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.096023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:45.096023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:45:45.096023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:45:45.098014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee90d9-3828-407a-a45a-412c0a86ac3c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.124538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 750/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:45:44 2022] PUT /identity/v3/projects/00bf76de4afd419c85da910aad92d5b1/users/b7cf9bfe13b44c0a9d5d5272e74d0ac9/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:45.136904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2ae9-e2ca-4d18-b974-d29e7645dfbe None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.137250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2ae9-e2ca-4d18-b974-d29e7645dfbe None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.137531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2ae9-e2ca-4d18-b974-d29e7645dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.200464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-84ad2ae9-e2ca-4d18-b974-d29e7645dfbe None None] MFA Rules not processed for user `b7cf9bfe13b44c0a9d5d5272e74d0ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:45.201648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-84ad2ae9-e2ca-4d18-b974-d29e7645dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.281314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 752/1502] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:45:45.300521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.300812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.301122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.302460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 751/1503] 10.222.0.13 () {54 vars in 964 bytes} [Tue Aug 30 11:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:45.307764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1af4-91e3-4bf5-8108-12e406193301 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.308055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1af4-91e3-4bf5-8108-12e406193301 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.308330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1af4-91e3-4bf5-8108-12e406193301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.340283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.386320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7bbb1af4-91e3-4bf5-8108-12e406193301 None None] MFA Rules not processed for user `aea417bef9414609b3c79bbf2cc2ced2`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:45.387649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7bbb1af4-91e3-4bf5-8108-12e406193301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.467742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 753/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Aug 30 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:45:45.477565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.479093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.542065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.599964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999fec-e2b3-4311-a66a-ee4d8681ed16 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.684600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.685516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.685853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.686182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.688410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.795753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.797232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.800649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.815870 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 752/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:45:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:45:45.868891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9107b-4584-4443-9987-47c3e6ea3f27 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.869347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9107b-4584-4443-9987-47c3e6ea3f27 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.869481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9107b-4584-4443-9987-47c3e6ea3f27 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.871201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 754/1506] 10.222.0.13 () {52 vars in 830 bytes} [Tue Aug 30 11:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:45.875300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.876529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.979545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ade6-0cc6-475c-8194-ca895a0e422d service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:46.092401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:46.093069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:46.093380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:46.093619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] PATH_INFO: `/v3/users/b7cf9bfe13b44c0a9d5d5272e74d0ac9` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:46.106784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cf9bfe13b44c0a9d5d5272e74d0ac9)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:46.107834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:46.107834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:45:46.107834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:45:46.109114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:46.118702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:46.184387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cf9bfe13b44c0a9d5d5272e74d0ac9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:46.209702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cf9bfe13b44c0a9d5d5272e74d0ac9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:46.226244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cf9bfe13b44c0a9d5d5272e74d0ac9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:46.226733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cf9bfe13b44c0a9d5d5272e74d0ac9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:46.227259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cf9bfe13b44c0a9d5d5272e74d0ac9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:46.245107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 753/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:45:45 2022] DELETE /identity/v3/users/b7cf9bfe13b44c0a9d5d5272e74d0ac9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:46.249593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:46.249881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:46.250160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:46.307195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:46.308402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:46.389173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:46.402159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 755/1508] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:45:46.416332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:46.417624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:46.529107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00a65-c25b-49b3-83ee-f32554fce06e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:46.709311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:46.732554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:46.733202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:46.733481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:46.733749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:46.735376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:46.849523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:46.850967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429e9e-e33c-46d1-a69d-2c46f5200eaf service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:46.870377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 754/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:45:47.249125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:47.250449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:47.261871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c7e9-93a7-4ba0-9aa3-390840a685db None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:47.358589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:47.359228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.359511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.359783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] PATH_INFO: `/v3/projects/00bf76de4afd419c85da910aad92d5b1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.369870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bf76de4afd419c85da910aad92d5b1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:47.370901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:45:47.370901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:45:47.370901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:45:47.372100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:47.438540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bf76de4afd419c85da910aad92d5b1', 'request_id': 'req-b45017e3-9e28-4743-941b-cfe06ded9218'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:47.445511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bf76de4afd419c85da910aad92d5b1', 'request_id': 'req-b45017e3-9e28-4743-941b-cfe06ded9218'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:47.459298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bf76de4afd419c85da910aad92d5b1', 'request_id': 'req-b45017e3-9e28-4743-941b-cfe06ded9218'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:47.493307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] The token cache is being invalidate because project 00bf76de4afd419c85da910aad92d5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:45:47.493538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:47.493973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b45017e3-9e28-4743-941b-cfe06ded9218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:45:47.495400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 756/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:45:47 2022] DELETE /identity/v3/projects/00bf76de4afd419c85da910aad92d5b1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:56.867500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=62 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:57.491078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:17.952793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:17.953395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:17.953395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:17.955416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:17.960687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938105-4c2d-49b2-92bc-b6a1f7ba55c8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:17.961207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938105-4c2d-49b2-92bc-b6a1f7ba55c8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:17.961393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938105-4c2d-49b2-92bc-b6a1f7ba55c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:18.047047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-78938105-4c2d-49b2-92bc-b6a1f7ba55c8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:18.048304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-78938105-4c2d-49b2-92bc-b6a1f7ba55c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:18.171735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:18.327524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:18.331611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:18.464417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7de798-2456-47b9-9c6e-4340bd99a9f0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:18.470422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:18.471043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:18.471320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:18.471592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:18.480357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:18.482024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbff47-5d40-486f-9f8f-0939d970eead service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:18.491850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 756/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:19.336225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb183-054a-4dca-a314-406b2a8fd1d7 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:19.337090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb183-054a-4dca-a314-406b2a8fd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:19.337090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb183-054a-4dca-a314-406b2a8fd1d7 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:19.339294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:19.346795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f958-280c-4f75-82eb-4aa8a0f8da3f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:19.347289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f958-280c-4f75-82eb-4aa8a0f8da3f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:19.347396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f958-280c-4f75-82eb-4aa8a0f8da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:19.368422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8009f958-280c-4f75-82eb-4aa8a0f8da3f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:19.370263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8009f958-280c-4f75-82eb-4aa8a0f8da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:19.379867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:19.541548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb183-054a-4dca-a314-406b2a8fd1d7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:19.558713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb183-054a-4dca-a314-406b2a8fd1d7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:19.564757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:19.565389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:19.565668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:19.565941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:19.574703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:19.576296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d75990-3f23-49ce-8b7b-9522a9ad1809 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:19.586183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 759/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:20.288278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1a93-a07f-4b0f-81f9-3d5c5bdbed89 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:20.288503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1a93-a07f-4b0f-81f9-3d5c5bdbed89 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:20.288753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1a93-a07f-4b0f-81f9-3d5c5bdbed89 None None] PATH_INFO: `/v3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:20.290081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 758/1517] 10.222.0.18 () {54 vars in 925 bytes} [Tue Aug 30 11:47:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:20.296554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04fbef-8da9-4957-b1b6-b4f1ce7f779a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:20.296845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04fbef-8da9-4957-b1b6-b4f1ce7f779a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:20.297143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04fbef-8da9-4957-b1b6-b4f1ce7f779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:20.361904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4f04fbef-8da9-4957-b1b6-b4f1ce7f779a None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:20.363116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4f04fbef-8da9-4957-b1b6-b4f1ce7f779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:20.382765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:20.440143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 760/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Aug 30 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:24.290757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805799cb-26ac-4747-b24a-f44c2221a069 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:24.291350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805799cb-26ac-4747-b24a-f44c2221a069 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:24.291350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805799cb-26ac-4747-b24a-f44c2221a069 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:24.292657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 759/1519] 10.222.0.13 () {54 vars in 961 bytes} [Tue Aug 30 11:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:24.298736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8a37-ebeb-41c1-a3cf-6f59829db899 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:24.299184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8a37-ebeb-41c1-a3cf-6f59829db899 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:24.299303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8a37-ebeb-41c1-a3cf-6f59829db899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:24.326899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b73b8a37-ebeb-41c1-a3cf-6f59829db899 None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:24.328808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b73b8a37-ebeb-41c1-a3cf-6f59829db899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:24.343549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 761/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Aug 30 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:24.351220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805799cb-26ac-4747-b24a-f44c2221a069 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:24.367401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805799cb-26ac-4747-b24a-f44c2221a069 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:24.373623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:24.374242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:24.374542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:24.374819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:24.383805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:24.385440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6a75-661f-47d6-b4df-55f339b6dbcc service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:24.395523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 760/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:30.826833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec642-b90f-4a78-b2ae-a16a7b242130 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:30.827718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec642-b90f-4a78-b2ae-a16a7b242130 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:30.827718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec642-b90f-4a78-b2ae-a16a7b242130 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:30.830402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:47:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:30.838408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8ee7-7fef-4936-a214-b145b2f54c5a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:30.838859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8ee7-7fef-4936-a214-b145b2f54c5a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:30.838967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8ee7-7fef-4936-a214-b145b2f54c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:30.862258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-500b8ee7-7fef-4936-a214-b145b2f54c5a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:30.863439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-500b8ee7-7fef-4936-a214-b145b2f54c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:30.871749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:31.024460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec642-b90f-4a78-b2ae-a16a7b242130 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:31.041481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec642-b90f-4a78-b2ae-a16a7b242130 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:31.047224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:31.047835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:31.048116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:31.048391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:31.057095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:31.058698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153ef32-3038-440d-bf1a-6c9f0c3e9312 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:31.068770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 763/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:31.897235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a8bc-277b-45bb-aab7-b71a9fdfca2f None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:31.898124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a8bc-277b-45bb-aab7-b71a9fdfca2f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:31.898124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a8bc-277b-45bb-aab7-b71a9fdfca2f None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:31.900188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:31.906744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc928ef-cd6a-4b73-bcc8-478a79aa0135 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:31.907164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc928ef-cd6a-4b73-bcc8-478a79aa0135 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:31.907282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc928ef-cd6a-4b73-bcc8-478a79aa0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:31.928150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ddc928ef-cd6a-4b73-bcc8-478a79aa0135 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:31.929423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ddc928ef-cd6a-4b73-bcc8-478a79aa0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:31.938326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:32.088840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a8bc-277b-45bb-aab7-b71a9fdfca2f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:32.114063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a8bc-277b-45bb-aab7-b71a9fdfca2f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:32.124642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:32.125376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:32.125653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:32.125919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:32.135167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:32.136794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c8de-752d-49d7-a390-2c70ddb20512 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:32.146991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 763/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:35.833036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:35.833576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:35.833576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:35.835685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:35.843908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c128-e5dd-4590-a311-400709943cc3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:35.844322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c128-e5dd-4590-a311-400709943cc3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:35.844455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c128-e5dd-4590-a311-400709943cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:35.865964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-faf2c128-e5dd-4590-a311-400709943cc3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:35.867157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-faf2c128-e5dd-4590-a311-400709943cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:35.876475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:36.176488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:36.178556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:36.273252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8beff-d9c5-41d4-9a22-e0cbff96bec6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:36.278096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:36.278706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:36.279048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:36.279312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:36.289264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:36.291082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a95f-a9e9-4b47-b938-4b6f6cf86ad1 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:36.304662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 766/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:38.167663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:38.168570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:38.168570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:38.170446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:38.178342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a404dc-3795-4bd1-b77d-a21f53d21bce None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:38.178800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a404dc-3795-4bd1-b77d-a21f53d21bce None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:38.178893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a404dc-3795-4bd1-b77d-a21f53d21bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:38.202078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a7a404dc-3795-4bd1-b77d-a21f53d21bce None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:38.203271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a7a404dc-3795-4bd1-b77d-a21f53d21bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:38.212957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:47:38.497989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:38.500198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:38.520472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69698e64-1704-41cb-b3ee-548be07c8e91 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:38.525041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:38.525644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:38.525943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:38.526208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:38.535780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:38.537362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826e2ae-462e-4e42-8321-27ea4e38a422 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:38.546817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 766/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:41.965985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:41.966963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:41.967225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:41.969553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:47:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:41.974928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f7b1-3698-4813-bd48-f2fd3b0bb951 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:41.975380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f7b1-3698-4813-bd48-f2fd3b0bb951 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:41.975482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f7b1-3698-4813-bd48-f2fd3b0bb951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:41.995757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fb54f7b1-3698-4813-bd48-f2fd3b0bb951 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:41.996931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fb54f7b1-3698-4813-bd48-f2fd3b0bb951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:42.005253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:42.556603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:42.559331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:42.625961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:42.641763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d1e8-b6ed-4c91-a26a-023aac6215e6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:42.645640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:42.646238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:42.646516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:42.646778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:42.656318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:42.657778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdae25-7c2b-4c19-931c-4ec65b6dc790 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:42.667634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 769/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:44.709807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.710438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.710438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.712038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:44.718562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103108-0f07-4713-82da-66120058d149 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.719202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103108-0f07-4713-82da-66120058d149 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.719202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103108-0f07-4713-82da-66120058d149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.750155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-32103108-0f07-4713-82da-66120058d149 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:44.751308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-32103108-0f07-4713-82da-66120058d149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:44.761390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:47:45.351849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:45.353928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:45.373249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04d5f-0e8b-4eb6-b4f8-64f1fb324817 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:45.377409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:45.378013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:45.378286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:45.378553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:45.388638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:45.390330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194e6e-e604-49f4-b933-854ae22df52e service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.400140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 769/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:47:54.743224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=11 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:55.396016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:10.619039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f482-e305-4288-9887-af9f23099256 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.620432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f482-e305-4288-9887-af9f23099256 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.620432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f482-e305-4288-9887-af9f23099256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.646244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-af08f482-e305-4288-9887-af9f23099256 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:10.647875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-af08f482-e305-4288-9887-af9f23099256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:10.657056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 771/1540] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:10.666538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.667798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.668325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.692953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:10.695574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:10.702768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.703555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.704057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.711881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 770/1541] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:10.716583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:10.733340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6212df-7cb6-4724-b16c-cd0336f0c337 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:10.739108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:10.739991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.740346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:10.740620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.741106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.741930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:10.742061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:10.742502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:10.743689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:10.743689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:49:10.743689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:49:10.744933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2d7b2-82d8-4739-904a-c548649c29f9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:10.763930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 772/1542] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:10.769528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 771/1543] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:49:10.772886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:10.773296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7275cd-96cf-43b2-992a-0fa38d24dd1e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.773775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7275cd-96cf-43b2-992a-0fa38d24dd1e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.774218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7275cd-96cf-43b2-992a-0fa38d24dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.795965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d9c61-ed11-4151-82b7-9e0510cc763e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:10.806344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9f7275cd-96cf-43b2-992a-0fa38d24dd1e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:10.807668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9f7275cd-96cf-43b2-992a-0fa38d24dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:10.813809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:10.815112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.815949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.816451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.817369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:10.818626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:10.818626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:49:10.818626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:49:10.820399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:10.837557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 772/1544] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:10.838986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:10.839269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:10.839539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:10.888830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:10.890240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:10.905445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 773/1545] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:10.906791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:10.909652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 773/1546] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:10.912993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:10.926966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059eebe-4eaa-4051-8fad-e41b785a9850 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.041372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c028-68cb-429e-9027-12bef22989b9 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.049849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.050493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.050778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.051052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.051724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.052030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.052896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.053705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b515-bd68-42b0-b35e-33077e80bd66 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.053939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.054227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.054503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.055142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.056166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:11.056166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:49:11.056166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:49:11.057387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.073924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 774/1547] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.078872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84f18-b80e-4e09-bc99-fe92a603e318 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.079163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84f18-b80e-4e09-bc99-fe92a603e318 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.079440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84f18-b80e-4e09-bc99-fe92a603e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.111876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 774/1548] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:10 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.113910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.114493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4aa84f18-b80e-4e09-bc99-fe92a603e318 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.116029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4aa84f18-b80e-4e09-bc99-fe92a603e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.130950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a8d2-9dc2-4bb3-97a2-5d99ec7b132d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.138538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.139218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.139501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.139776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.140563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.142647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.144921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 775/1549] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.146413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121724-f5dd-4b29-9c9e-f593b5fbc43c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.146700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121724-f5dd-4b29-9c9e-f593b5fbc43c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.146980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121724-f5dd-4b29-9c9e-f593b5fbc43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.178037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fd121724-f5dd-4b29-9c9e-f593b5fbc43c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.179409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fd121724-f5dd-4b29-9c9e-f593b5fbc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.197446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 775/1550] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.197446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.200287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 776/1551] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.205904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319bc5f-f8f1-4e84-ae89-ba8b1c147067 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.206436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319bc5f-f8f1-4e84-ae89-ba8b1c147067 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.206881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319bc5f-f8f1-4e84-ae89-ba8b1c147067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.229943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a319bc5f-f8f1-4e84-ae89-ba8b1c147067 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.231323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a319bc5f-f8f1-4e84-ae89-ba8b1c147067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.271401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369cd57-98c2-4d18-9c4d-92072597f231 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.276264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.276919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.277242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.277520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.278175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.279895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.290637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 776/1552] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:11.294136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.299034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 777/1553] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.305080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87e4a-4434-47fa-b414-8fedc9400fa0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.305080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87e4a-4434-47fa-b414-8fedc9400fa0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.305080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87e4a-4434-47fa-b414-8fedc9400fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.305480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e369-cf24-4245-a062-0818d699f33d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.311447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.312310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.312587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.312858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.314475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.314774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.316492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.324530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5ea87e4a-4434-47fa-b414-8fedc9400fa0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.325886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5ea87e4a-4434-47fa-b414-8fedc9400fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.333190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 777/1554] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.334453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.339266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 778/1555] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.340613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e276ba2-a883-4a45-b07f-145c6eb02c4e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.340901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e276ba2-a883-4a45-b07f-145c6eb02c4e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.341211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e276ba2-a883-4a45-b07f-145c6eb02c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.347081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13bcb-c565-4cf5-b929-61e95e335fe4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.354663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.355330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.355599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.355871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.356536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.358998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.365783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2e276ba2-a883-4a45-b07f-145c6eb02c4e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.366986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2e276ba2-a883-4a45-b07f-145c6eb02c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.376587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:11.381157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 779/1556] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.381157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864844a-19c3-4448-8304-9147d821abb3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.381157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864844a-19c3-4448-8304-9147d821abb3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.381157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864844a-19c3-4448-8304-9147d821abb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.382862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 778/1557] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.384222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.396170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad847-f818-40dc-99dd-3c596d38f413 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.399751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b864844a-19c3-4448-8304-9147d821abb3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.400808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.400943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b864844a-19c3-4448-8304-9147d821abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.401455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.401741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.402012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.402683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.404406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412bd9-2fbf-441d-9d46-22d56365b0fd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.408957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 780/1558] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.410174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.410453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.410719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.415359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 779/1559] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:11.416765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e9d-8517-44e6-8a07-f8ea35e8be3a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.417157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e9d-8517-44e6-8a07-f8ea35e8be3a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.417438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e9d-8517-44e6-8a07-f8ea35e8be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.435201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.436109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-429b0e9d-8517-44e6-8a07-f8ea35e8be3a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.436530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.437415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-429b0e9d-8517-44e6-8a07-f8ea35e8be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.444985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 781/1560] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.449109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 780/1561] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.449273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.449361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.449361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.449361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.460477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98db6-ca5e-4878-ab3f-b48fce82b271 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.465105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.465726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.466000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.466263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.466887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.468180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.468823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.469445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.478148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 781/1562] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.478891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:11.479033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.489245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f27815-cf87-45d6-80b7-e3864add1500 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.497532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.498151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.498454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.498723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.499369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.499679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.501443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961a5f6-2a05-456a-9f94-89bd3e3bb226 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.504300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 782/1563] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.505198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.514070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 782/1564] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.515679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.516117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.516559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.535932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.537239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.568796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a198-03c4-4581-bb6d-391743059f91 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.573468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.574082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.574358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.574627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.575273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.577127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.587634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 783/1565] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:11.588419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.598205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f623f49-1a3b-4ae6-a80f-ed4ea276fde0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.600062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 783/1566] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.600846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.602911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.603641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.603831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.604100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] PATH_INFO: `/v3/projects/0e1a8a0e77484f62a4099651ecc7da4b/users/13a05e058c86463f94e7e00ba3a9248d/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.612109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e103c86-c86c-4cd6-82b7-7ad1bf92fdc1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.617849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.618505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.618785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.619033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.619321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1a8a0e77484f62a4099651ecc7da4b, user_id=13a05e058c86463f94e7e00ba3a9248d, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.619799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.620020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.620379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:11.620379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:49:11.620379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:49:11.621728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc062f7a-7e43-4edc-b3f8-90a320a5932f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.622632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.634036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 784/1567] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.635360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.635642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.635915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.645018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 784/1568] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:11 2022] PUT /identity/v3/projects/0e1a8a0e77484f62a4099651ecc7da4b/users/13a05e058c86463f94e7e00ba3a9248d/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:11.649142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.665664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.667277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.711472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc373bb-0cfc-46dd-a463-9942b00723f8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.716125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.716737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.717045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.717372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.718020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.718315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.719916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.730477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 785/1569] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.731370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.740427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 785/1570] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.740427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.741213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3ea2b-9a7c-45f0-989b-054e4700c668 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.746150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.746758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.747032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.747300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.747926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.749933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.750196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001602-fd10-47ce-9dbb-d40f909e4924 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.755253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.755889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.756173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.756447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.757117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.759226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.771931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 786/1571] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.772892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.782953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba0b55-d24b-4c12-8882-5978790fb6b6 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.788094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.788926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.789236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.789506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.790148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.791785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.793988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 786/1572] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.798106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.802732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 787/1573] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:11.805996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.816254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8ced-b2dc-4bb1-9238-39aac8bd1f4a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.834311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:11.834666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:11.862680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14652-7776-4a64-9f83-43e7d8f6da4c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.867542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.868158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.868443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.868719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.869395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:11.869702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.871309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5994ea-53bf-4e94-8006-38106d3f2bee admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.874794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.875389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.875668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.875941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.876572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.878511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.884993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 787/1574] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:11.884993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.884993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.884993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.913356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] MFA Rules not processed for user `13a05e058c86463f94e7e00ba3a9248d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:11.914572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:11.919799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 788/1575] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:11.919799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.978406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a8872-41d2-4383-8303-0a0d7fe3f6c6 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:11.983195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 788/1576] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:11.985108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:11.985108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:11.985342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:11.985423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:11.985423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:11.985423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:11.987131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:11.995548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137dfb-c0b8-4234-9a00-9208bf6b39d5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.000406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.001040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.001321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.001596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.002248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:12.002556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.004161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.017334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 789/1577] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:12.018259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.026840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 789/1578] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:11 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.028309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.033317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7a425-377f-4946-aa3d-92d157b80168 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.092753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.093303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.093579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.093848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.094486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.095827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ffc04-7801-4c3e-9320-107da80d9d1f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.096110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.100368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.101006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.101277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.101546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.102164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.104055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.106115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 790/1579] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.106706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.116787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a9a26-730f-445a-86dc-57b894326c55 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.121747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.122392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.122668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.122942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] PATH_INFO: `/v3/projects/58be3761e1a24433b43356e7c95bb581/users/fd8160b9e33e4eebb02d8908ebc5f696/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.126130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 790/1580] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.129272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.136571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90d6bf-3bba-4099-826f-cea92dc158f5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.141438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.142038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.142315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.142516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=58be3761e1a24433b43356e7c95bb581, user_id=fd8160b9e33e4eebb02d8908ebc5f696, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.142636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.143192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.145101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.145268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.160086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 791/1581] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:12 2022] PUT /identity/v3/projects/58be3761e1a24433b43356e7c95bb581/users/fd8160b9e33e4eebb02d8908ebc5f696/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:12.161458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.171742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.179396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 791/1582] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.179964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.180950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.226099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5297-6c48-4d72-9532-e3a6d14da3bb admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.242973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045aa78-9892-4a27-9382-ea80d61c9729 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.247952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.248890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.249205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.249468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.250119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.252052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079f7c6-a89d-4307-8164-ad29bf50ac8f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.280150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 792/1583] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.281650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf18-3aec-460d-ace7-84349086c52e None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.281933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf18-3aec-460d-ace7-84349086c52e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.282204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf18-3aec-460d-ace7-84349086c52e None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.283496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 793/1584] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 11:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:12.284049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cf18-3aec-460d-ace7-84349086c52e None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.284386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.285099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.285457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.285820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.286537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.288790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.313792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 792/1585] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.315045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.325730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464d1fe-71b8-4df6-9d1c-ac0bf56cd004 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.351349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cf18-3aec-460d-ace7-84349086c52e None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.355854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.356552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.356893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.357237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.358043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.360037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.383967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 794/1586] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.384868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.388398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.389126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.389421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.389688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.390343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.391952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e333c-2ffd-4f45-a0d6-41009ca92c52 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.395549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc4996-55a4-4b29-acc9-a43e42d761a3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.400265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.400860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.401171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.401442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.402217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 793/1587] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.402341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.403302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.403585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.403816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.403934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.415583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 795/1588] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.416594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.422780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:12.423981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:12.426346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceafafa-400b-4614-9777-04c0f01919c5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.430876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.431496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.431764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.432034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.432650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.433252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 794/1589] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:12.433968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.434594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e7a7e-1a07-4247-9a0e-20957d39cf46 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.444737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1b4b-dc97-49ff-9ad1-73e6aba0b38a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.449926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.450609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.450938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.451249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.451887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.453873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.458621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 796/1590] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.460114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.460408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.460682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.479804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 795/1591] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:12.479804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.489723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395164-d3e8-4920-a1f2-b31a788a7721 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.494356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.495021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.495312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.495580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.496237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.497903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.505357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:12.506608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:12.509855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 796/1592] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.510647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.521301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d420-42dd-43de-8dc1-a754711eea6a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.526376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.527057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.527456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.527804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.528563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.530482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.541298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 797/1593] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.541451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.545631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.551310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.558130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528119-1570-42f0-a243-7a736bc7f4ca admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.563172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.563865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.564147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.564419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] PATH_INFO: `/v3/projects/34e5e51633eb4f6db718dde1e91befb1/users/638f3a2a617a4ab4b2dfb9a86ad675fe/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.579184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e5e51633eb4f6db718dde1e91befb1, user_id=638f3a2a617a4ab4b2dfb9a86ad675fe, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.581863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 797/1594] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:12.582701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.585490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.593949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718f36-975c-42c4-9787-62792c3ee950 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.600245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 798/1595] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:12 2022] PUT /identity/v3/projects/34e5e51633eb4f6db718dde1e91befb1/users/638f3a2a617a4ab4b2dfb9a86ad675fe/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:12.610623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.650929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.651577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.651869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.652145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.652787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.654464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.664921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 798/1596] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.666125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.672824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76d80-8941-42df-801f-ee7d6cf501ba admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.676772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.677398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5608a-c044-461c-8e32-893c578b8fec admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.677783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.678037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.678376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.681897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.682495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.682769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.683037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.683668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.685275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.688541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.690017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.695427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 799/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.696035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.700212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 799/1598] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:12.700904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.706158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99ac3-f86a-4f8d-b00f-8a919007fa35 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.711788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd598b6c-eb44-4549-a63e-8653d37cc143 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.713667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.714272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.714518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.715228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.715398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.717008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.718799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.719511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.719895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.720269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.721293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.722776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.733000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 800/1599] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.733000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.737481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 800/1600] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.737481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.743150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b80abf-e0a6-4ef8-8088-bb36b180eda4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.749050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.749668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.749943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.750217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.750855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.752464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fe6df-2e34-4077-9847-be18aaffc771 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.763375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 801/1601] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:12.764612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.764901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.765197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.797136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] MFA Rules not processed for user `638f3a2a617a4ab4b2dfb9a86ad675fe`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:12.798333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:12.823800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d875f6-181e-45dc-949c-c64aca5851f5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.831022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.831618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.831874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.832150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.872225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 802/1602] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:12.873096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.884363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc97a8-496b-4512-b595-53c6c064b900 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.890154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:12.890827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:12.891095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:12.891362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] PATH_INFO: `/v3/projects/43884d82758e4d0792ada02369db39f3/users/ba5122591b374f85b91a554a2ac51850/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:12.905111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.907214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.913251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43884d82758e4d0792ada02369db39f3, user_id=ba5122591b374f85b91a554a2ac51850, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:12.917457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:12.920175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.922230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 801/1603] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:12.923695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:12.935316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229d8b5-0404-4a5c-a05f-71268f46ed48 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:12.938882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 803/1604] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:12 2022] PUT /identity/v3/projects/43884d82758e4d0792ada02369db39f3/users/ba5122591b374f85b91a554a2ac51850/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:12.939538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:12.939872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.010129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.010816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.011146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.011428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.012268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.012597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9fd-614f-4d5d-95c4-23ed1e3ce678 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.014136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.018014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.018516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.018852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.019184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.020038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.021857 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.030045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 802/1605] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:13.030045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.036089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 804/1606] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:13.036089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.046874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7203c7-d4d6-4305-9b40-320400eecbb8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.052081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.052784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db83a-8e1b-4afb-b449-bd6c99d4a822 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.052924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.053332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.053821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] PATH_INFO: `/v3/projects/feaa5fd11de845f8becb1cae8eff16d9/users/0daac83c004748d69d07e6d26dd2fd81/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.059617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.060510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.061004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.061453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] PATH_INFO: `/v3/projects/41fb3d0666e141c7acb903752ab7a9a9/users/4e8cf175e30848558db4c8d8ef247e54/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.070847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feaa5fd11de845f8becb1cae8eff16d9, user_id=0daac83c004748d69d07e6d26dd2fd81, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.073866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.079049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fb3d0666e141c7acb903752ab7a9a9, user_id=4e8cf175e30848558db4c8d8ef247e54, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.082164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dad7a-cd14-461d-823c-5eaaba16b18a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.092027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 805/1607] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:13 2022] PUT /identity/v3/projects/feaa5fd11de845f8becb1cae8eff16d9/users/0daac83c004748d69d07e6d26dd2fd81/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:13.093334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.117625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 803/1608] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:13 2022] PUT /identity/v3/projects/41fb3d0666e141c7acb903752ab7a9a9/users/4e8cf175e30848558db4c8d8ef247e54/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:13.120770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.122753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.123446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.183568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] MFA Rules not processed for user `ba5122591b374f85b91a554a2ac51850`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:13.184916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:13.226643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe12e-0395-43e1-8574-8c28aa492ff8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.271803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 804/1609] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:13.271803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.302947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.303817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.304099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.304372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.305163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.307630 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.334145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:13.348728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 806/1610] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:13.348728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.355348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0e2ef-e283-4e32-aeee-88abaddaeac4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.369797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:13.439042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.439042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.439042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.440003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] PATH_INFO: `/v3/projects/89e8bcc5fa1c4489bbad8bc83820f5cb/users/15a42851b6cd48f7b3882b14bb605279/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.441621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27e35b-3e46-4dee-a00c-a656d98d459e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.447555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.448493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.448954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.449486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] PATH_INFO: `/v3/projects/f61b8a724b7d4536b7676ca6dc425e41/users/bee132c315de41cb91a5fce6e3bd4c7b/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.463317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e8bcc5fa1c4489bbad8bc83820f5cb, user_id=15a42851b6cd48f7b3882b14bb605279, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.466978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae99846-415e-4273-868f-1328c0ed5df6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.475130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b8a724b7d4536b7676ca6dc425e41, user_id=bee132c315de41cb91a5fce6e3bd4c7b, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.480010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dca855-2878-4e55-9517-5d0d7063d958 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.497880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 805/1611] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:13 2022] PUT /identity/v3/projects/89e8bcc5fa1c4489bbad8bc83820f5cb/users/15a42851b6cd48f7b3882b14bb605279/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:13.499825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.500290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.500747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.514489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 807/1612] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:13 2022] PUT /identity/v3/projects/f61b8a724b7d4536b7676ca6dc425e41/users/bee132c315de41cb91a5fce6e3bd4c7b/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:13.514489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.515102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.515102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.534388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:13.535669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:13.541883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] MFA Rules not processed for user `0daac83c004748d69d07e6d26dd2fd81`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:13.543206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:13.630671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 808/1613] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:13.630671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.641774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 806/1614] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:13.644606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.656504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e3c8-476e-479f-8df1-58aecfe964fd None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.661416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.662181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.662527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.662960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.663666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.665635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0641-7ff1-4f37-bf44-8ff2bfb08ffe admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.693603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 807/1615] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:13.695032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3af4-efb5-44d3-8d46-f38fdb17aac6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.695327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3af4-efb5-44d3-8d46-f38fdb17aac6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.695591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3af4-efb5-44d3-8d46-f38fdb17aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.724554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee359bee-3f82-408d-84f0-099f3f84d3ae None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.731236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.731762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4dcb3af4-efb5-44d3-8d46-f38fdb17aac6 None None] MFA Rules not processed for user `15a42851b6cd48f7b3882b14bb605279`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:13.732248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.732672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.733181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4dcb3af4-efb5-44d3-8d46-f38fdb17aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:13.733407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.755476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:13.804827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.806888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4aa2-7514-49ac-ad90-d5191ae8dc0c service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.818001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:13.818436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 809/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:13.819952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.820404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.820834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.842513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 808/1617] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:13.845530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:13.845924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216d03-e108-4cd1-b1e3-5c1d3e8f02d7 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.846700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216d03-e108-4cd1-b1e3-5c1d3e8f02d7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.847370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216d03-e108-4cd1-b1e3-5c1d3e8f02d7 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.848599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:13.856900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 809/1618] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 11:49:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:13.858598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 810/1619] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:13.858841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e216d03-e108-4cd1-b1e3-5c1d3e8f02d7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.860000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.872557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1379-c9f9-4304-9fd2-d1186b104cf1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:13.879114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:13.879754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:13.880043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:13.880317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:13.881171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:13.883249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:13.919865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 811/1620] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:13 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:13.922050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:13.951703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e216d03-e108-4cd1-b1e3-5c1d3e8f02d7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.006727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e530ce-cf2a-40f6-94c1-bcbc9551dd36 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.014508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.015590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.016039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.016550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.017988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.021116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.032180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.033150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.033495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.033828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.037633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 812/1621] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:14.038917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.050292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.051799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1207fc-fd2a-4f56-9d51-1e43cdee2381 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.052471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389303e5-1a31-4c2d-8af8-990cf1636f73 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.057518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.058657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.058941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.059215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.062243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.064524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.072032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 810/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:14.073625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d01c-8ebe-4939-a607-b34f4544df4e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.074055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d01c-8ebe-4939-a607-b34f4544df4e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.075029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d01c-8ebe-4939-a607-b34f4544df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.104120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 813/1623] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:14.105908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.109037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4829d01c-8ebe-4939-a607-b34f4544df4e None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:14.114533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4829d01c-8ebe-4939-a607-b34f4544df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:14.258840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c536d3-c002-4e11-a9ad-63c1dc3faf33 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.268861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.269566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.269845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.270119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.292745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 811/1624] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:14.293128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:14.294827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9daad-e49c-4c58-82ca-40416316cd5b None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.296791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9daad-e49c-4c58-82ca-40416316cd5b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.297395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9daad-e49c-4c58-82ca-40416316cd5b None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.306657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 812/1625] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 11:49:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:14.307646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9daad-e49c-4c58-82ca-40416316cd5b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.377574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.379661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.411090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 814/1626] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:14.412008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.429367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46a68-a62c-4c37-b2ad-cc2afa8da7cf service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.439622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.440647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.440996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.441620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] PATH_INFO: `/v3/projects/317ef86bd1464348ae2a9e20df6abd26/users/cf6efa04ec1a422292e893366ac91fbe/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.466509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:14.474591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317ef86bd1464348ae2a9e20df6abd26, user_id=cf6efa04ec1a422292e893366ac91fbe, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.477440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.522440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 815/1627] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:14 2022] PUT /identity/v3/projects/317ef86bd1464348ae2a9e20df6abd26/users/cf6efa04ec1a422292e893366ac91fbe/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:14.522440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.527265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9daad-e49c-4c58-82ca-40416316cd5b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.631567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a712-840c-4802-acd5-1950ed14d0d4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.636658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.637321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.637602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.637876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.638540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.640913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d696f4-773b-43fd-9a77-709e99ee2923 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.660444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.661128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.661402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.665236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.665989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.672528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 816/1628] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:14.672528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f976-1bb3-49f4-9b8e-f4956fea35a5 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.673065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.673149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f976-1bb3-49f4-9b8e-f4956fea35a5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.673149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f976-1bb3-49f4-9b8e-f4956fea35a5 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.673717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 817/1629] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 11:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:14.674988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.675268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.675552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.701944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:14.781102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:14.785826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 813/1630] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:14.785826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.785826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2212b0-140c-412d-88a2-4bd259630b0c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.785826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.786805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.786805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.786805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.786805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.786805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.811107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 814/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:14.811107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.833656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90d40-18c0-4165-aedb-b066bb5dab76 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.839421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.840123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.840507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.840876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.841645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.843797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8c0ff-4c4e-4373-9ee8-5120f1ba9a39 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.858351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 815/1632] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:14.859248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.859595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.860266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.879776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 818/1633] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:14.882918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:14.884192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:14.890108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.899299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 816/1634] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:14.900169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.910153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ee9f2-060a-4f51-9019-e6152aad61f6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.916282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.916925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.917430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.917697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.919094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.920241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7390ac-9b3d-483c-a3e6-0e48dcc2e3be None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:14.921674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.929306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:14.930172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:14.930367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:14.931089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] PATH_INFO: `/v3/projects/317ef86bd1464348ae2a9e20df6abd26/users/cf6efa04ec1a422292e893366ac91fbe/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:14.931848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:14.932738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317ef86bd1464348ae2a9e20df6abd26, user_id=cf6efa04ec1a422292e893366ac91fbe, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:14.936859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:14.950945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 819/1635] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:14.953834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.961087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 817/1636] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:14 2022] PUT /identity/v3/projects/317ef86bd1464348ae2a9e20df6abd26/users/cf6efa04ec1a422292e893366ac91fbe/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:14.961087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:14.973558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929205-9db3-4fd8-849f-e7716a66127b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.066648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745a37-df76-4ce2-a335-46c7028770a9 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.073894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.074932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.075430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.076046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.083173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.083821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.084202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.084400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] PATH_INFO: `/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4/users/c6a21e7de9774d8aa52ffb774533e233/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.114571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a1d4f3ab8406d84955111ddf99ef4, user_id=c6a21e7de9774d8aa52ffb774533e233, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.118390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.166219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 820/1637] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:14 2022] PUT /identity/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4/users/c6a21e7de9774d8aa52ffb774533e233/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:15.167237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.168161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:15.197769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.199541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.214169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 818/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:15.215221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.234390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e5b9-4c8c-4760-b445-1773a58ca282 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.288371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3918a-904e-49da-92cc-6468a04458f0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.304228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.310276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.310587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.310922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.379803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.380614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.380998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.381375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] PATH_INFO: `/v3/projects/c41f3f7c95964bf291e7e93418c0813d/users/179777ec086b417398a3c1f01b72985e/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.423804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41f3f7c95964bf291e7e93418c0813d, user_id=179777ec086b417398a3c1f01b72985e, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.427179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa2f1-ce5b-448d-a69d-8af177c03f73 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.452608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 819/1639] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:15 2022] PUT /identity/v3/projects/c41f3f7c95964bf291e7e93418c0813d/users/179777ec086b417398a3c1f01b72985e/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:15.452608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.452608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.453372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.496837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.496837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.515099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 821/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:15.515807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.522525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] MFA Rules not processed for user `cf6efa04ec1a422292e893366ac91fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:15.523996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:15.546459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4431-be06-429e-b277-74cf148e0281 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.612917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:15.653017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 820/1641] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:15.654196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.693852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.694494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.694775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.695051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.697843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.700407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.728565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 822/1642] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:15.729670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.800184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:15.820795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90111ee8-9366-41e0-a9d4-3e8e37e90c0d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.835245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.838252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.838505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.838783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.842561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.844221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.884313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 821/1643] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:15.885230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.915527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b34e1-da08-4758-92de-2d617190fa7a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.915954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acd7a-c480-421b-be55-bb2faf0fa47e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:15.925993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.926926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.927242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.929318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.936594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:15.937653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:15.939238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:15.939729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] PATH_INFO: `/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4/users/c6a21e7de9774d8aa52ffb774533e233/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:15.945501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a1d4f3ab8406d84955111ddf99ef4, user_id=c6a21e7de9774d8aa52ffb774533e233, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.949606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.960145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:15.963831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9db2-80cd-4090-9631-ebd651375982 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:15.986771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 822/1644] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:15 2022] PUT /identity/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4/users/c6a21e7de9774d8aa52ffb774533e233/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:15.987608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:15.989164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 823/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:15.999633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1c4a-f263-4f8d-9199-a698ebdc8367 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.000063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1c4a-f263-4f8d-9199-a698ebdc8367 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.000442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1c4a-f263-4f8d-9199-a698ebdc8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.054940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-174d1c4a-f263-4f8d-9199-a698ebdc8367 None None] MFA Rules not processed for user `c6a21e7de9774d8aa52ffb774533e233`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:16.059419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-174d1c4a-f263-4f8d-9199-a698ebdc8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:16.203940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f173b-ca44-4936-8014-e09efd4ee4fb admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:16.228832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:16.228832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.228832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.228832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] PATH_INFO: `/v3/projects/c41f3f7c95964bf291e7e93418c0813d/users/179777ec086b417398a3c1f01b72985e/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.231883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41f3f7c95964bf291e7e93418c0813d, user_id=179777ec086b417398a3c1f01b72985e, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:16.237108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:16.264703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 824/1646] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:16.282633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 823/1647] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:15 2022] PUT /identity/v3/projects/c41f3f7c95964bf291e7e93418c0813d/users/179777ec086b417398a3c1f01b72985e/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:16.283805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.284134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.284411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.366667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:16.368428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] MFA Rules not processed for user `179777ec086b417398a3c1f01b72985e`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:16.370456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:16.527996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f086-b8d7-44ea-bcfb-f7d6109a531f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:16.533805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:16.534504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.534889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.535166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.540284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:16.657873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 825/1648] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:16.657873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:16.760843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:16.762352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:16.806839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 824/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:16.828321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a146a2-a2f9-4e5b-b866-95bab5edc7be None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:16.847888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:16.849188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.849188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.849188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] PATH_INFO: `/v3/users/13a05e058c86463f94e7e00ba3a9248d` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.850770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a05e058c86463f94e7e00ba3a9248d)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:16.851381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:16.855672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:16.860082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04994-9093-449c-94c1-557796bc3130 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:16.876388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:16.877058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:16.877341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:16.877610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:16.896658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:16.898327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397886d7-7ef6-4733-b81d-2c3ca5ec471f service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:16.917395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 825/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:17.002811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a05e058c86463f94e7e00ba3a9248d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:17.038627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a05e058c86463f94e7e00ba3a9248d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:17.059399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a05e058c86463f94e7e00ba3a9248d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:17.061438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a05e058c86463f94e7e00ba3a9248d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:17.062732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a05e058c86463f94e7e00ba3a9248d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:17.106459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 826/1651] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:16 2022] DELETE /identity/v3/users/13a05e058c86463f94e7e00ba3a9248d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:17.108400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:17.108780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:17.109224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:17.169505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:17.171761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.185234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:17.266249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:17.268265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.293765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 826/1652] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:17.333483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:17.335216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.363681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291fb0-fdd3-4730-9ca7-002446b3307f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:17.367879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:17.368551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:17.368838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:17.369280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:17.371422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.378289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:17.475619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61b1b-c8cf-49f7-963a-bf035b6f27d0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:17.478380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:17.480893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:17.481206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:17.481483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:17.481906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:17.483039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:17.504030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:17.506164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:17.508204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 827/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:17.510561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:17.515647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.518701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 827/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:17.533862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786858f-7e5e-479d-a8e0-24133a314732 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:17.543033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:17.545427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:17.547244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:17.547721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:17.554263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:17.702517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:17.713595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:17.744315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 828/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:18.480859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:18.483033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:18.518608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca208c5-a7aa-45e6-a3dc-07638e18f91a service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:18.527124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:18.528247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:18.528903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:18.529432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] PATH_INFO: `/v3/projects/0e1a8a0e77484f62a4099651ecc7da4b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:18.532659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1a8a0e77484f62a4099651ecc7da4b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:18.536958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:18.612007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:18.617462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:18.669289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8afc1a-183a-40a0-a634-7bb2368f5295 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:18.674546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1a8a0e77484f62a4099651ecc7da4b', 'request_id': 'req-48677fc1-e6bd-40bc-9399-03b58b0ba126'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.691477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1a8a0e77484f62a4099651ecc7da4b', 'request_id': 'req-48677fc1-e6bd-40bc-9399-03b58b0ba126'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.721131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1a8a0e77484f62a4099651ecc7da4b', 'request_id': 'req-48677fc1-e6bd-40bc-9399-03b58b0ba126'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.774212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] The token cache is being invalidate because project 0e1a8a0e77484f62a4099651ecc7da4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:18.774781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.777460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-48677fc1-e6bd-40bc-9399-03b58b0ba126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.779855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 828/1656] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:18 2022] DELETE /identity/v3/projects/0e1a8a0e77484f62a4099651ecc7da4b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:18.787548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52839d-5ad1-4b94-9fdc-6b8e1245baa7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:18.787907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52839d-5ad1-4b94-9fdc-6b8e1245baa7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:18.788296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52839d-5ad1-4b94-9fdc-6b8e1245baa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:18.837991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:18.838652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:18.838934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:18.839209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] PATH_INFO: `/v3/users/638f3a2a617a4ab4b2dfb9a86ad675fe` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:18.840359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] RBAC: Authorizing `identity:delete_user(user_id=638f3a2a617a4ab4b2dfb9a86ad675fe)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:18.842509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:18.844876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2e52839d-5ad1-4b94-9fdc-6b8e1245baa7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:18.846607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2e52839d-5ad1-4b94-9fdc-6b8e1245baa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:18.878815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 829/1657] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:18.886974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:18.887057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:18.887400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:18.927958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638f3a2a617a4ab4b2dfb9a86ad675fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.930195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:18.943206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:18.944638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:18.950192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638f3a2a617a4ab4b2dfb9a86ad675fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.969046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 830/1658] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:18.970378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:18.973563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638f3a2a617a4ab4b2dfb9a86ad675fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.975196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638f3a2a617a4ab4b2dfb9a86ad675fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:18.977339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a4f1012b-a6d8-433b-a696-0a7080b1689d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638f3a2a617a4ab4b2dfb9a86ad675fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:19.000134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39f732-552d-4a76-827d-9377488560d2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.010414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 829/1659] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:18 2022] DELETE /identity/v3/users/638f3a2a617a4ab4b2dfb9a86ad675fe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:19.013586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.014302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.014584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.014850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.015517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:19.015617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.015831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.016885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.017262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.022147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.044214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:19.045723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:19.052761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 831/1660] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:19.056947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.058853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:19.114197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8a1f-4147-42ce-8a85-bcbd856313a1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.130703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:19.235923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 830/1661] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:19.287805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.290968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.291350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.291635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.292321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.297202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.298806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:19.307043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.425385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 832/1662] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:19 2022] POST /identity/v3/projects => generated 371 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:19.428763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.545342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86403e-1906-47b3-b5ab-b220987849f8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.640109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3733a7-69f9-4126-99af-0ba2afc3915f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.658258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.658916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.659199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.659473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.660120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.662381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.730234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 833/1663] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:19 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:19.733656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.768103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f23-a1da-4f3c-8957-0563bc23228d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.770584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.771544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.771825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.772135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.780371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.781318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.781820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.782459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.784262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.790870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.818401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.821289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.831266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 834/1664] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:19.832740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.838454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:19.850915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 831/1665] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:19.851822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:19.868320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a9e2-651d-4977-b66d-c3b2a16d1917 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.886526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.887184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.890369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026f263-2e0f-40ab-a5c1-afde2f4a7136 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:19.900381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.902763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.903485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.904654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:19.906952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:19.907233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:19.907507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] PATH_INFO: `/v3/users/ba5122591b374f85b91a554a2ac51850` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:19.911365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.912906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5122591b374f85b91a554a2ac51850)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:19.915129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: WARNING py.warnings [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:19.915129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: warnings.warn(msg) Aug 30 11:49:19.915129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: Aug 30 11:49:19.920791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:19.964814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 832/1666] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:19.968389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.039765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9ea5-aeac-4e0c-b5dd-87c3c09b5c27 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.077424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.078128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.078404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.078678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] PATH_INFO: `/v3/projects/f751c2b721cf487eb6c51071b172391d/users/fd27a27abb20406181cbc6de51f36457/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.082936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5122591b374f85b91a554a2ac51850'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:20.112095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5122591b374f85b91a554a2ac51850'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:20.135884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5122591b374f85b91a554a2ac51850'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:20.138656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5122591b374f85b91a554a2ac51850'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:20.142137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:20.161123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f751c2b721cf487eb6c51071b172391d, user_id=fd27a27abb20406181cbc6de51f36457, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.169422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed0614-0c1f-498e-84d5-a97ad7f8aee7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:20.179408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:20.206135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-35b20565-825a-44be-a86b-7fd90027f258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5122591b374f85b91a554a2ac51850'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:20.225692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 833/1667] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:19 2022] PUT /identity/v3/projects/f751c2b721cf487eb6c51071b172391d/users/fd27a27abb20406181cbc6de51f36457/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:20.230804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 835/1668] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:19 2022] DELETE /identity/v3/users/ba5122591b374f85b91a554a2ac51850 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:20.238856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.239197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.240005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.246313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.250308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.253281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.313667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] MFA Rules not processed for user `fd27a27abb20406181cbc6de51f36457`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:20.315364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:20.315497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:20.319453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:20.462686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 836/1669] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:20.487472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 834/1670] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:20.488807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.491283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:20.509133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.511426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:20.531553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b1cd6-768a-495c-9d7b-4877e0232262 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.550099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.550564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.550845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.551540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.552119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.554243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:20.622464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a373fc8-1a62-47ad-ad4f-89e43c6b3491 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.624317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 837/1671] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:20 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:20.628314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.762704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03d0f4-62a1-4926-8ba8-9a7fa7004a2b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.764265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.766390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.766695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.766971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.775767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.777524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.778611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.779042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.781764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.788829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:20.794883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.797242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:20.826945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 835/1672] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:20.842741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 838/1673] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:20 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:20.848224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.863493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6237b8-15ce-40f8-8ef3-e07bfbf7bd7a service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.871444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.872575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.872888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.873742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.874618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.876359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:20.899307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 836/1674] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:20.899447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:20.915616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6157-4a1c-4970-9171-d3bc2c4ae9ab admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:20.964278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:20.967095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:20.967631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:20.968355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] PATH_INFO: `/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04/users/803eb112b23740a4952d9b9d5d355632/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:20.988752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf7d4ca4a514726b2514faa2a2a8f04, user_id=803eb112b23740a4952d9b9d5d355632, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:20.994928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:21.030855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 839/1675] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:20 2022] PUT /identity/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04/users/803eb112b23740a4952d9b9d5d355632/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:21.037850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:21.055782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1d07-f71e-44f0-84fd-2826635bc137 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:21.146871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:21.297001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:21.300085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:21.302549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:21.302906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:21.304961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:21.322147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b43d-67a3-476e-b019-bc4e89b0b73a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:21.361390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 837/1676] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:21.363073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:21.398317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4f46-19a7-47f7-bd7e-de024329d6a7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:21.410327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:21.411023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:21.411300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:21.411569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] PATH_INFO: `/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04/users/803eb112b23740a4952d9b9d5d355632/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:21.414410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf7d4ca4a514726b2514faa2a2a8f04, user_id=803eb112b23740a4952d9b9d5d355632, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:21.419499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:21.445112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 840/1677] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:21 2022] PUT /identity/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04/users/803eb112b23740a4952d9b9d5d355632/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:21.454112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:21.454337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:21.454577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:21.552114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] MFA Rules not processed for user `803eb112b23740a4952d9b9d5d355632`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:21.554087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:21.560267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:21.562645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:21.600985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:21.777019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a825-b26b-4057-9e8e-886da8163793 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:21.799877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:21.807133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 838/1678] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:21.808657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:21.808945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:21.809231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] PATH_INFO: `/v3/projects/34e5e51633eb4f6db718dde1e91befb1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:21.810811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e5e51633eb4f6db718dde1e91befb1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:21.812856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:21.816153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:21.818108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:21.936845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e5e51633eb4f6db718dde1e91befb1', 'request_id': 'req-4dd95d26-659c-4edf-a2e5-1185229e3013'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:21.954398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e5e51633eb4f6db718dde1e91befb1', 'request_id': 'req-4dd95d26-659c-4edf-a2e5-1185229e3013'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:21.967605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945bb6-35eb-41cd-a9fe-026217f78c50 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:21.974198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e5e51633eb4f6db718dde1e91befb1', 'request_id': 'req-4dd95d26-659c-4edf-a2e5-1185229e3013'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.001243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] The token cache is being invalidate because project 34e5e51633eb4f6db718dde1e91befb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:22.001595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.003171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.007342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 841/1679] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:21 2022] DELETE /identity/v3/projects/34e5e51633eb4f6db718dde1e91befb1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:22.011279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:22.012892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:22.116704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:22.117380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:22.121219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:22.122268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:22.131123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:22.184484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:22.208875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd95d26-659c-4edf-a2e5-1185229e3013 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:22.219624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:22.220541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:22.220818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:22.221146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] PATH_INFO: `/v3/users/cf6efa04ec1a422292e893366ac91fbe` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:22.226794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6efa04ec1a422292e893366ac91fbe)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:22.230111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:22.343395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:22.349734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7550-c2c3-4747-914f-425b0245df63 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:22.383145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 839/1680] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:22.385000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6efa04ec1a422292e893366ac91fbe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.388593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:22.404268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6efa04ec1a422292e893366ac91fbe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.437127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6efa04ec1a422292e893366ac91fbe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.438907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6efa04ec1a422292e893366ac91fbe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.503278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6efa04ec1a422292e893366ac91fbe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:22.520881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 842/1681] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:22 2022] DELETE /identity/v3/users/cf6efa04ec1a422292e893366ac91fbe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:22.578098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:22.578313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:22.578640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:22.636157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] MFA Rules not processed for user `fd8160b9e33e4eebb02d8908ebc5f696`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:22.636157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:22.645273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:22.647572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:22.782107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1a4a0-1f90-4e1c-8762-5da810bf1221 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:22.803353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:22.808705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 840/1682] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:22.818666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:22.818958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:22.819209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:22.821820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:22.827141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:22.828882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.012178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:23.016099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:23.066034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 843/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:23.081512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ba0a-4a2c-4971-9134-77118874bddd None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:23.098723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:23.099807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.100696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.101237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.123948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:23.128833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:23.167640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 841/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:23.178494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:23.180258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.323724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:23.325482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.446425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:23.470477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3747a9-0de7-4fb9-b4ae-39be8e6646fe service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:23.492216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:23.493169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.493648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.494194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] PATH_INFO: `/v3/projects/43884d82758e4d0792ada02369db39f3` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.497046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43884d82758e4d0792ada02369db39f3)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:23.500354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:23.563480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:23.566120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2112-266b-425b-994a-8550afd91f72 service nova] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:23.589395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:23.590058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.590500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.590772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] PATH_INFO: `/v3/users/15a42851b6cd48f7b3882b14bb605279` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.597805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a42851b6cd48f7b3882b14bb605279)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:23.599976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:23.619077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43884d82758e4d0792ada02369db39f3', 'request_id': 'req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.645992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43884d82758e4d0792ada02369db39f3', 'request_id': 'req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.665659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43884d82758e4d0792ada02369db39f3', 'request_id': 'req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.711768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] The token cache is being invalidate because project 43884d82758e4d0792ada02369db39f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:23.712121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.715801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-da1d3a8d-027f-41b3-8e06-0114e7dfdc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.716188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a42851b6cd48f7b3882b14bb605279'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.720099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 844/1685] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:23 2022] DELETE /identity/v3/projects/43884d82758e4d0792ada02369db39f3 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:23.726235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.726533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.726858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.746265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a42851b6cd48f7b3882b14bb605279'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.764522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a42851b6cd48f7b3882b14bb605279'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.765484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a42851b6cd48f7b3882b14bb605279'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.766199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-58f60556-e516-4557-a60c-4d2c41a9a209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a42851b6cd48f7b3882b14bb605279'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:23.802139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:23.806577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 842/1686] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:23 2022] DELETE /identity/v3/users/15a42851b6cd48f7b3882b14bb605279 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:23.808023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.811649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.811649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.831620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.840040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:23.841649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.955097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 843/1687] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:23.956119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:23.958808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.981940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 845/1688] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:23.982965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:23.985897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.989331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f19ea4-21cf-4904-aa43-c248d0e61440 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:23.994939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:23.995647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.996016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.996298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] PATH_INFO: `/v3/projects/317ef86bd1464348ae2a9e20df6abd26` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.998104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317ef86bd1464348ae2a9e20df6abd26)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:23.998894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: WARNING py.warnings [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:49:23.998894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: warnings.warn(msg) Aug 30 11:49:23.998894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: Aug 30 11:49:24.000241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.103255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:24.124137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317ef86bd1464348ae2a9e20df6abd26', 'request_id': 'req-7fa2800b-bcba-4ade-8254-9fd030b26f24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:24.126473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb0dd5-f381-4d50-8398-b81dd35a04b8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.153137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317ef86bd1464348ae2a9e20df6abd26', 'request_id': 'req-7fa2800b-bcba-4ade-8254-9fd030b26f24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:24.174956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317ef86bd1464348ae2a9e20df6abd26', 'request_id': 'req-7fa2800b-bcba-4ade-8254-9fd030b26f24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:24.196235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] The token cache is being invalidate because project 317ef86bd1464348ae2a9e20df6abd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:24.197160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:24.198606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7fa2800b-bcba-4ade-8254-9fd030b26f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:24.202246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 844/1689] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:23 2022] DELETE /identity/v3/projects/317ef86bd1464348ae2a9e20df6abd26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:24.208294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade80c0-d17b-44d3-8dfa-3587bf0d54e2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.210543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade80c0-d17b-44d3-8dfa-3587bf0d54e2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.210543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade80c0-d17b-44d3-8dfa-3587bf0d54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.241835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.242935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.243275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.243607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.249427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:24.250582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7ade80c0-d17b-44d3-8dfa-3587bf0d54e2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:24.253398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7ade80c0-d17b-44d3-8dfa-3587bf0d54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:24.288416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:24.408071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.409254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 845/1690] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:24.410855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.411762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.412225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.413749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.436056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 846/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:24.437212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.478662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782cb59-a353-43c9-8a26-eca83c114c2c service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.487848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:24.487848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:24.497508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.497508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.497508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.497508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.498150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:24.498506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.501500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712135d3-0b54-4b44-92bb-a613008425d5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.517083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 847/1693] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:24.517392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 846/1693] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:24.522253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.524410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.524696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.524990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.539951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22205c3e-c8b9-4aac-9746-5602e61e6d02 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.553751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.555438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.556949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.557696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.560317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.567879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.572676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:24.574991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:24.586838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 848/1694] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:24.592739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.615091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde1368-f8e4-4678-89c9-fbc7d2be0a09 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.625424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 847/1695] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:24.632850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.634088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.634088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.634249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.635430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.635615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:24.635909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.637811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.653909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 849/1696] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:24.661069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.690930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9d78-35ee-42ee-a4b1-6aeebbd403ce admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.805132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f74c-9d91-49b0-abbb-608007eecad7 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.818966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.819634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.819867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.820132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.822383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.828479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.850499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.854355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.854355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.855800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.857082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.865080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.883920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 848/1697] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:24.887132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.911460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f6552-b47f-4f3c-aa01-851c57abbbdd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.925742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.926397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.929283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.929283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.929822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.931478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.936659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 850/1698] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:24.941470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.959982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 849/1699] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:24.968041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:24.998760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1003-e645-4023-952b-0d1cb5b77c87 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.069771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:25.142455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57d9b-e5e9-49f2-a73d-ff66c176fc54 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.152997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.154173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.160492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.161655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.162511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.163977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.164818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.165280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.165621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.166549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.168387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.168914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.192065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 850/1700] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:25.194067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.206366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:25.227766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 851/1701] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:24 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:25.230914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f835-bcaa-4927-a593-7abdc20a2be0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.231084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.247737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.249427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.249739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.250280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] PATH_INFO: `/v3/projects/21772abb09c9477faa6dc31a0e5d477a/users/7a7b63da333a4b069c11de723eca0ed2/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.254665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd679f8-f2bb-4253-84c4-b4a26438f8da admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.265027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.265725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.266079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.266477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.267302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.269124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.289223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 852/1702] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:25.289223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.305771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21772abb09c9477faa6dc31a0e5d477a, user_id=7a7b63da333a4b069c11de723eca0ed2, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.309781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52f940-1085-4b91-9c7c-0f0fa772c20e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.312336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d6f7-ad85-47c5-bedf-c24cfb057098 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.326918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.328826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.330582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.331018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.332991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.334876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.350963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 851/1703] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:25 2022] PUT /identity/v3/projects/21772abb09c9477faa6dc31a0e5d477a/users/7a7b63da333a4b069c11de723eca0ed2/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:25.353067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.353217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.353498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.369044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 853/1704] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:25.370329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.386047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] MFA Rules not processed for user `7a7b63da333a4b069c11de723eca0ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:25.388006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:25.401216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c208d-14fb-4646-8dee-f12babcc3dab admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.597412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 852/1705] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:25.597806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.598601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.598887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.599163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] PATH_INFO: `/v3/projects/51f2d776e15c411198aa3cfff1c7129e/users/9ebebc18ad3e448ab7642dfa0469d515/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.609363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.611178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:25.629642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f2d776e15c411198aa3cfff1c7129e, user_id=9ebebc18ad3e448ab7642dfa0469d515, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.632482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cf40-4f15-44bd-bd19-19f725bbd151 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.665765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 854/1706] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:25 2022] PUT /identity/v3/projects/51f2d776e15c411198aa3cfff1c7129e/users/9ebebc18ad3e448ab7642dfa0469d515/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:25.676888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.676888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.676888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.715867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347921ab-fca4-4f23-bb8b-34d099eca7c0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:25.756467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] MFA Rules not processed for user `9ebebc18ad3e448ab7642dfa0469d515`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:25.757727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:25.759059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:25.787477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:25.788335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:25.788715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:25.789137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:25.868316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 855/1707] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:25.869397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:25.870870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:25.942006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:25.944305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:25.962872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:25.975460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 853/1708] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:25.978463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.006237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220ada-e5a2-4c97-91d5-1cf813347ea5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.018636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.019607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.019813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.020148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] PATH_INFO: `/v3/projects/89e8bcc5fa1c4489bbad8bc83820f5cb` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.022318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e111f-fe52-4049-9cea-f5ed953f7681 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.023712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e8bcc5fa1c4489bbad8bc83820f5cb)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.025708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.040853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.042509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.044588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.045319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.048841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.056535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.133418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 854/1709] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:25 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:26.137181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.144290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e8bcc5fa1c4489bbad8bc83820f5cb', 'request_id': 'req-9d65fd74-b009-4d63-984b-96a17c166c4f'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.164605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e8bcc5fa1c4489bbad8bc83820f5cb', 'request_id': 'req-9d65fd74-b009-4d63-984b-96a17c166c4f'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.187755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e8bcc5fa1c4489bbad8bc83820f5cb', 'request_id': 'req-9d65fd74-b009-4d63-984b-96a17c166c4f'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.214975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] The token cache is being invalidate because project 89e8bcc5fa1c4489bbad8bc83820f5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:26.215769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.216509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.220300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 856/1710] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:25 2022] DELETE /identity/v3/projects/89e8bcc5fa1c4489bbad8bc83820f5cb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:26.224989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.230441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:26.273840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca776-2dd6-415c-a4a2-2d59781f02f4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.280607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.281545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.282000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.282646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.283542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.286912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.325505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 855/1711] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:26 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:26.327467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.334446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:26.368614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6bec-da07-4151-b6ab-3ebd0c81df98 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.381979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.385065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.385540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.386629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.387430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.395153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.430813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 856/1712] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:26.431786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.458677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25094-1dc9-41e9-8f41-23449719115f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.466091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.466916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.467464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.468252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] PATH_INFO: `/v3/projects/65a882e2595c420ab92a5e88d8878b61/users/1b149fb25a35467d8681bb77f3ebb90f/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.469162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65fd74-b009-4d63-984b-96a17c166c4f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.497268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.498622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.501654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.502942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] PATH_INFO: `/v3/users/c6a21e7de9774d8aa52ffb774533e233` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.504721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a21e7de9774d8aa52ffb774533e233)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.507290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.508243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a882e2595c420ab92a5e88d8878b61, user_id=1b149fb25a35467d8681bb77f3ebb90f, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.511665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.568567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 857/1713] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:26 2022] PUT /identity/v3/projects/65a882e2595c420ab92a5e88d8878b61/users/1b149fb25a35467d8681bb77f3ebb90f/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:26.575303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.699532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a21e7de9774d8aa52ffb774533e233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.712134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:26.732154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a21e7de9774d8aa52ffb774533e233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.764354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a21e7de9774d8aa52ffb774533e233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.767147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a21e7de9774d8aa52ffb774533e233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.801255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a21e7de9774d8aa52ffb774533e233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:26.803713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:26.819968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20e17-0ccd-418b-a120-eef397e62cca admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:26.821825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 857/1714] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:26 2022] DELETE /identity/v3/users/c6a21e7de9774d8aa52ffb774533e233 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:26.934492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:26.935342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.935688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.936009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.937477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:26.940149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f467-2779-4d97-b4c6-48e3ae9d183a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:26.962014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.963593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:26.970862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 858/1715] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:26.997747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712b675-264b-4170-acb5-9cf168e332c8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:27.013963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:27.015404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.015665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.015929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] PATH_INFO: `/v3/projects/65a882e2595c420ab92a5e88d8878b61/users/1b149fb25a35467d8681bb77f3ebb90f/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.022742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a882e2595c420ab92a5e88d8878b61, user_id=1b149fb25a35467d8681bb77f3ebb90f, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:27.026153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:27.054868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 858/1716] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:26 2022] PUT /identity/v3/projects/65a882e2595c420ab92a5e88d8878b61/users/1b149fb25a35467d8681bb77f3ebb90f/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:27.066007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.066397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.066765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.116426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] MFA Rules not processed for user `1b149fb25a35467d8681bb77f3ebb90f`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:27.119060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:27.301735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 859/1717] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:27.325285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:27.330426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:27.477123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201bb8-4a44-4c9b-a8e7-e70da2b41e53 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:27.491031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:27.492380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.492380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.492380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.505450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:27.507471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:27.522498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:27.523807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8dad-0c98-45c3-96b5-3fae5b9416cd service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:27.541476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 859/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:27.641455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:27.652708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7d1b2-5b4a-4607-b365-64798fd86404 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:27.659964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:27.661514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.664849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.665372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] PATH_INFO: `/v3/users/0daac83c004748d69d07e6d26dd2fd81` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.667324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0daac83c004748d69d07e6d26dd2fd81)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:27.670157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:27.764104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0daac83c004748d69d07e6d26dd2fd81'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:27.808230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0daac83c004748d69d07e6d26dd2fd81'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:27.828615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0daac83c004748d69d07e6d26dd2fd81'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:27.830748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0daac83c004748d69d07e6d26dd2fd81'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:27.831298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0daac83c004748d69d07e6d26dd2fd81'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:27.876025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 860/1719] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:27 2022] DELETE /identity/v3/users/0daac83c004748d69d07e6d26dd2fd81 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:27.876731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79048e-336f-422f-85da-40ce04f359d2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.877151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79048e-336f-422f-85da-40ce04f359d2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.877491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79048e-336f-422f-85da-40ce04f359d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.928321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8e79048e-336f-422f-85da-40ce04f359d2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:27.929880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8e79048e-336f-422f-85da-40ce04f359d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.070287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 860/1720] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:28.118243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:28.119826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.162775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.163352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.163860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.252367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] MFA Rules not processed for user `fd8160b9e33e4eebb02d8908ebc5f696`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:28.257991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.357396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbab82-ac80-436d-aec6-94e5dca05257 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:28.369651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:28.377122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.377122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.379912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.412892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:28.415654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:28.445289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 861/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:28.446192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:28.447570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.481943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 861/1722] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:28.497876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:28.507603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.516138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f398e5-eeab-45d9-817f-2321ebd4d57e service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:28.528334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:28.529994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.532154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.532563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] PATH_INFO: `/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.535556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9a1d4f3ab8406d84955111ddf99ef4)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:28.542328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:28.612644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:28.686728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9a1d4f3ab8406d84955111ddf99ef4', 'request_id': 'req-a80b4850-d75a-4fc4-9a8f-be53331bbee2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:28.696410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9a1d4f3ab8406d84955111ddf99ef4', 'request_id': 'req-a80b4850-d75a-4fc4-9a8f-be53331bbee2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:28.705719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9a1d4f3ab8406d84955111ddf99ef4', 'request_id': 'req-a80b4850-d75a-4fc4-9a8f-be53331bbee2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:28.721858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:28.735199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] The token cache is being invalidate because project ca9a1d4f3ab8406d84955111ddf99ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:28.736169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:28.738470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a80b4850-d75a-4fc4-9a8f-be53331bbee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:28.746443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 862/1723] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:28 2022] DELETE /identity/v3/projects/ca9a1d4f3ab8406d84955111ddf99ef4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:28.746539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944943ca-32a6-4f6b-8ef4-13777f4df520 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:28.747894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257640-900d-4909-bfb5-21fef980e9c7 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.748275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257640-900d-4909-bfb5-21fef980e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.748627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257640-900d-4909-bfb5-21fef980e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.784349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c5257640-900d-4909-bfb5-21fef980e9c7 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:28.786145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c5257640-900d-4909-bfb5-21fef980e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.911785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b149fb25a35467d8681bb77f3ebb90f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65a882e2595c420ab92a5e88d8878b61', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:28.912575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.912991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.913745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.914229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:28.914794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:28.924761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:28.938668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 862/1724] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:28.942563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:28.944293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:28.960437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af13c-901b-4b70-bed0-4d96659a5e5b tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:28.961688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 863/1725] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:28.971288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.971586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.971783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.975548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b149fb25a35467d8681bb77f3ebb90f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65a882e2595c420ab92a5e88d8878b61', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:28.976402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:28.977054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:28.977729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:28.978528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:28.980791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.006904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:29.010466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.025183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 864/1726] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:29.034930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.046456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 863/1727] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:28 2022] POST /identity/v3/projects => generated 354 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:29.049211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.064513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71578d65-88c3-45e7-b9d3-3bbc418d40e5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.203180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26a7a9-6df1-44ae-b39e-d4983c7c4637 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.218613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b149fb25a35467d8681bb77f3ebb90f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65a882e2595c420ab92a5e88d8878b61', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.219278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.219564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.222263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.223087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:29.223918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.229464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.239098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.240994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.241287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.241556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.244539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:29.244931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.248440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.258744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 864/1728] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:29.280810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.285443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 865/1729] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:29.299720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c5701-1b0a-4004-8b56-c3740cb33686 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.321335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.321591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.322434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.322944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.323379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.324200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.326513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.336187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f011c-8b43-47bd-a728-ce06f531155c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.353741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b149fb25a35467d8681bb77f3ebb90f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65a882e2595c420ab92a5e88d8878b61', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.354412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.354701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.354985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] PATH_INFO: `/v3/projects/7d19fc00c91e46838f05190552004f97` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.356519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d19fc00c91e46838f05190552004f97)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.365697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.392694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 865/1730] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:29.397893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.475507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:29.500504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d19fc00c91e46838f05190552004f97', 'request_id': 'req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:29.522416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d19fc00c91e46838f05190552004f97', 'request_id': 'req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:29.538815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d19fc00c91e46838f05190552004f97', 'request_id': 'req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:29.559497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc27cf-6fec-421d-ac12-5aa4e72c9a92 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.587429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] The token cache is being invalidate because project 7d19fc00c91e46838f05190552004f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:29.588348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:29.589291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-79c9ca00-bb32-4130-b3a4-8e4eb49a4e99 tempest-VolumeQuotaClassesTest-266441686 tempest-VolumeQuotaClassesTest-266441686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:29.592650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 866/1731] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:29 2022] DELETE /identity/v3/projects/7d19fc00c91e46838f05190552004f97 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:29.594150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27610f3-f130-4d1e-a812-d9d72c89959f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.594591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27610f3-f130-4d1e-a812-d9d72c89959f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.595117 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27610f3-f130-4d1e-a812-d9d72c89959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.622358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:29.636227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b27610f3-f130-4d1e-a812-d9d72c89959f None None] MFA Rules not processed for user `bee132c315de41cb91a5fce6e3bd4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:29.638556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b27610f3-f130-4d1e-a812-d9d72c89959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.714045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.714750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.716530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.717259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.718006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.723796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ba2a6-c03e-4d54-9ac1-ba68a3be8e17 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.784109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 866/1732] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/users => generated 285 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:29.785639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.786051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.786378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.793920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 867/1733] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 11:49:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:29.797158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.805223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.850732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 867/1734] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:29.852074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.852363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.852645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.859137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9acffb-d503-4e7f-b0e1-417f70df06c5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:29.872497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:29.873235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.874115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.874860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.878272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:29.881803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22998c3-f7d7-4f91-9c20-0be1694998f4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:29.918237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 868/1735] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:29.921623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.922254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.922684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.983691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] MFA Rules not processed for user `bee132c315de41cb91a5fce6e3bd4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:29.985896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:29.993783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.994489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.020736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 869/1736] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:30.021855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.048914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5663f-3ddf-4f89-afd0-f8cc03851ec3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.065870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.066517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.066957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.067375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.068629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.072535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.100383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 870/1737] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:30.103965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.112041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.137882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 868/1738] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:30.139363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.141587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4d02-fab8-41cc-8610-599842c68ad7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.157968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.158648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.158931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.159203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] PATH_INFO: `/v3/projects/feaa5fd11de845f8becb1cae8eff16d9` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.160782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feaa5fd11de845f8becb1cae8eff16d9)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.162739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.167592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573c54e-5092-4c39-9768-9418167727a1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.188011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.189137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.189137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.189471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] PATH_INFO: `/v3/projects/7cb8a92c46d041be966be4f0b8b9dedd/users/3b5985de31ed4dccbf389ce50dd77787/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.231113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb8a92c46d041be966be4f0b8b9dedd, user_id=3b5985de31ed4dccbf389ce50dd77787, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.240716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.279984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 869/1739] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:30 2022] PUT /identity/v3/projects/7cb8a92c46d041be966be4f0b8b9dedd/users/3b5985de31ed4dccbf389ce50dd77787/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:30.281350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.283128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feaa5fd11de845f8becb1cae8eff16d9', 'request_id': 'req-653e9be6-a013-49be-9b87-aa44a3b70898'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.289867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.293033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feaa5fd11de845f8becb1cae8eff16d9', 'request_id': 'req-653e9be6-a013-49be-9b87-aa44a3b70898'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.308410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feaa5fd11de845f8becb1cae8eff16d9', 'request_id': 'req-653e9be6-a013-49be-9b87-aa44a3b70898'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.341227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] The token cache is being invalidate because project feaa5fd11de845f8becb1cae8eff16d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:30.341652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.343458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.351715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 871/1740] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:30 2022] DELETE /identity/v3/projects/feaa5fd11de845f8becb1cae8eff16d9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:30.351715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.353611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.406375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:30.427270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15b926-68eb-4f2c-8e67-5d25f207b50e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.457908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.458566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.458844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.459116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.461465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.475256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.477092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.487461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 870/1741] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:30.488508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:30.489978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.545441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:30.601596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e9be6-a013-49be-9b87-aa44a3b70898 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.676347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab69f-6a95-4a38-8304-c58e44cebdd9 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.689699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.690318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.690617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.691454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] PATH_INFO: `/v3/users/9ebebc18ad3e448ab7642dfa0469d515` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.694931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebebc18ad3e448ab7642dfa0469d515)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.704209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.831579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebebc18ad3e448ab7642dfa0469d515'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.864092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebebc18ad3e448ab7642dfa0469d515'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.877651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebebc18ad3e448ab7642dfa0469d515'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.880606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebebc18ad3e448ab7642dfa0469d515'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.881424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d6de1e71-12fd-4e00-a065-15cfa9f66ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebebc18ad3e448ab7642dfa0469d515'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:30.911271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.913196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.914573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 871/1742] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:30 2022] DELETE /identity/v3/users/9ebebc18ad3e448ab7642dfa0469d515 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:30.916009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42a78-3fb2-4939-b878-ada3917920b6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.916297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42a78-3fb2-4939-b878-ada3917920b6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.916623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42a78-3fb2-4939-b878-ada3917920b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.917014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.917498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.928134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.956420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b4d42a78-3fb2-4939-b878-ada3917920b6 None None] MFA Rules not processed for user `3b5985de31ed4dccbf389ce50dd77787`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:30.961953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b4d42a78-3fb2-4939-b878-ada3917920b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.146448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:31.149427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:31.206774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 872/1743] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:31.209853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:31.214964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 872/1744] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:31.219145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.221168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.222343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.222769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.270741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:31.272699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.290768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3d8-c202-4378-8b73-38e000b153f3 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:31.347775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:31.443984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:31.463781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:31.464789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.465484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.465906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] PATH_INFO: `/v3/users/179777ec086b417398a3c1f01b72985e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.467446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179777ec086b417398a3c1f01b72985e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:31.469758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:31.480322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 873/1745] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:31.482702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:31.495210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.528799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e935e-87e0-4dcc-a853-2b7c54d647f5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:31.535342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:31.536247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.536517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.536795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.540675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:31.550612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f9722-d375-4d1d-87de-722fa2cd4d30 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:31.560357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179777ec086b417398a3c1f01b72985e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:31.586117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179777ec086b417398a3c1f01b72985e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:31.605593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179777ec086b417398a3c1f01b72985e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:31.606729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179777ec086b417398a3c1f01b72985e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:31.634413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 874/1746] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:31 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:31.637030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.637317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.639684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.642825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179777ec086b417398a3c1f01b72985e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:31.662217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 873/1747] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:31 2022] DELETE /identity/v3/users/179777ec086b417398a3c1f01b72985e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:31.664504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:31.679085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.703763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] MFA Rules not processed for user `4e8cf175e30848558db4c8d8ef247e54`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:31.707193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.812252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 875/1748] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:31.812252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:31.812252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.853681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe967-8af5-4931-aabc-d41080d524e3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:31.863485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:31.864177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.864453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.864719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.866658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:31.911131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656ed7-0ce6-4213-b5e0-928efbea13b9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:31.917711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:31.918690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:31.919340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:31.923185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:31.924459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:31.927159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:31.967203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 876/1749] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:31 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:31.967846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:31.972744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.007037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.008638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a5ab-8607-452f-91b9-3d0a3ab148be service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.018272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:32.024522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 874/1750] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:32.027373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.027799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.028227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.054928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] MFA Rules not processed for user `4e8cf175e30848558db4c8d8ef247e54`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:32.056622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.065355 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 875/1751] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:32.066327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.078517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd708-c8b8-443a-a23a-b015e1a8dd4a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.087586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.089213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.089878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.090501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.091361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.093782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.109776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 876/1752] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:32.111187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.113260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.119241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:32.122068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0ab-66f6-4d0c-b267-414f73bb0441 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.132004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.132673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.132932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.133244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.135018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.149412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.151499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.168914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 877/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:32.170313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.184285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a66f6-b558-4e1e-95a3-daf191c5b1bc service placement] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.191730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.192428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.192707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.193006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] PATH_INFO: `/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5/users/c23f0b62904c4309942688f0b7a706da/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.236778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c68edcc6a74ec085c4ed43b84e97a5, user_id=c23f0b62904c4309942688f0b7a706da, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.243284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1018e6-6457-4c1d-bf43-e18d85cbaacc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.255741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bdce1-9be1-4bfe-b1e7-5e0be3284019 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.278568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.280231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.280709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.281110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.291159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 878/1754] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:32 2022] PUT /identity/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5/users/c23f0b62904c4309942688f0b7a706da/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:32.294660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021d91-5927-46e4-90a3-aebddb0bacdc None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.294660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021d91-5927-46e4-90a3-aebddb0bacdc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.297190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021d91-5927-46e4-90a3-aebddb0bacdc None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.303144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 879/1755] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 11:49:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:32.304485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021d91-5927-46e4-90a3-aebddb0bacdc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.309622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.316446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1e5c-7487-40dd-8e67-b8eb1f2063ca service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.349875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 877/1756] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:32.353707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.355126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.356380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.389952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:32.391553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.488187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021d91-5927-46e4-90a3-aebddb0bacdc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.499949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.502097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.502417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.502694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.505309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.506155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 878/1757] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:32.511336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.522287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.534292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c45c-3ae1-48b6-9516-432a9fc01b0e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.541088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 880/1758] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:32.543364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.546429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.547053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.547519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.548435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.564110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.564935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993c74-c16a-41d6-9dfe-c7e9d8b6835d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:32.567936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e59b5-58d2-428d-a729-4255aefe4283 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.576794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:32.578023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.578442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.578725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] PATH_INFO: `/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5/users/c23f0b62904c4309942688f0b7a706da/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.581400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c68edcc6a74ec085c4ed43b84e97a5, user_id=c23f0b62904c4309942688f0b7a706da, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:32.582725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 879/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:32.586339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:32.610526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 881/1760] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:32 2022] PUT /identity/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5/users/c23f0b62904c4309942688f0b7a706da/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:32.611716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.612115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.612811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.682545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] MFA Rules not processed for user `c23f0b62904c4309942688f0b7a706da`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:32.685005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.912737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 880/1761] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:32.922553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:32.924323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.129184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02d92-78b0-4fc6-bd9b-2d509876b09a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:33.147039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:33.147835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.148217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.148638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:33.170657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:33.174298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:33.202309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 882/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:33.211077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:33.213765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.243381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:33.264528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:33.267781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.312579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:33.511834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f5709-b559-4c9d-86c3-078bfb6450a8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:33.532167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:33.532842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.533656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.533656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] PATH_INFO: `/v3/projects/c41f3f7c95964bf291e7e93418c0813d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:33.534728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41f3f7c95964bf291e7e93418c0813d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:33.537059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:33.546610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b71f-c257-4e11-a6af-58b77f01475b service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:33.568015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:33.568802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.569138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.569426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] PATH_INFO: `/v3/projects/51f2d776e15c411198aa3cfff1c7129e` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:33.570660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f2d776e15c411198aa3cfff1c7129e)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:33.572878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:33.685566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41f3f7c95964bf291e7e93418c0813d', 'request_id': 'req-b918a071-1fe0-4c3e-81df-40be3706a8da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.708108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41f3f7c95964bf291e7e93418c0813d', 'request_id': 'req-b918a071-1fe0-4c3e-81df-40be3706a8da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.718229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f2d776e15c411198aa3cfff1c7129e', 'request_id': 'req-4d19afeb-4aea-4077-b04b-7c85903082e9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.728714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41f3f7c95964bf291e7e93418c0813d', 'request_id': 'req-b918a071-1fe0-4c3e-81df-40be3706a8da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.733725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f2d776e15c411198aa3cfff1c7129e', 'request_id': 'req-4d19afeb-4aea-4077-b04b-7c85903082e9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.755400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] The token cache is being invalidate because project c41f3f7c95964bf291e7e93418c0813d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:33.755698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.756933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f2d776e15c411198aa3cfff1c7129e', 'request_id': 'req-4d19afeb-4aea-4077-b04b-7c85903082e9'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.759034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b918a071-1fe0-4c3e-81df-40be3706a8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.763457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 881/1763] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:33 2022] DELETE /identity/v3/projects/c41f3f7c95964bf291e7e93418c0813d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:33.768581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbd4e-be8e-4f08-ab55-d1873c012dcc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.769373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbd4e-be8e-4f08-ab55-d1873c012dcc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.770094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbd4e-be8e-4f08-ab55-d1873c012dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:33.783576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] The token cache is being invalidate because project 51f2d776e15c411198aa3cfff1c7129e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:33.783878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.785649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:33.790778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 883/1764] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:33 2022] DELETE /identity/v3/projects/51f2d776e15c411198aa3cfff1c7129e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:33.804807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:33.808835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.814187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a69bbd4e-be8e-4f08-ab55-d1873c012dcc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:33.815872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a69bbd4e-be8e-4f08-ab55-d1873c012dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.977192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 882/1765] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:33.993473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.995327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.995756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.056218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:34.057685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:34.077327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 883/1766] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:34.078227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.098321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf3753-9358-47fb-9968-5f0a9d0d8976 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.099812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19afeb-4aea-4077-b04b-7c85903082e9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.108685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.109404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.109681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.109950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.110605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:34.110905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.112135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.113158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.113431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.113696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] PATH_INFO: `/v3/users/1b149fb25a35467d8681bb77f3ebb90f` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.115551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.117985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b149fb25a35467d8681bb77f3ebb90f)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.120294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.144052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 884/1767] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:34.150505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.169983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb805-c1b4-47ea-8800-8bc69b6d80cd admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.177734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.178922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.180248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.180620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.184392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.206466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.235281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:34.239520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b149fb25a35467d8681bb77f3ebb90f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:34.288904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:34.292116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b149fb25a35467d8681bb77f3ebb90f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:34.306560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 885/1768] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:34 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:34.307741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.319312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b149fb25a35467d8681bb77f3ebb90f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:34.351983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b149fb25a35467d8681bb77f3ebb90f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:34.353498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-cae0f5ab-8fcc-45a7-beff-1211d9aab968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b149fb25a35467d8681bb77f3ebb90f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:34.405426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f771-01d9-4de3-9b47-2fbec6d0fc63 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.414514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 884/1769] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:33 2022] DELETE /identity/v3/users/1b149fb25a35467d8681bb77f3ebb90f => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:34.420001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.420444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.420899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.527788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] MFA Rules not processed for user `bee132c315de41cb91a5fce6e3bd4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:34.531004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:34.536492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.538488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.543572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.546224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.550582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.560531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.619413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 886/1770] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:34 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:34.625106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.629798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:34.665866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b69d7-95a5-4af4-9f24-c6265779e005 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.677190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.679859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.680197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.680480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.684025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.688532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.725156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 887/1771] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:34.734077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.761194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 885/1772] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:34.794609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68a05-e88a-4e71-abeb-95b9db8e2e36 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.812017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.812437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.812722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:34.813011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:34.824579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:34.848444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91636de-8451-4022-aebd-2008b39da957 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:34.935673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 888/1773] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:34.939889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:34.961947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62e12d-238c-4f25-8881-abfc818a4b74 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:34.981328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:34.983470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:34.984254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:35.000121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] PATH_INFO: `/v3/projects/ede4f988c076470ab3b0255b4da0d013/users/e8ae860c885c453ab71c49794c0e2a21/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:35.058719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede4f988c076470ab3b0255b4da0d013, user_id=e8ae860c885c453ab71c49794c0e2a21, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:35.067191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:35.113288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 886/1774] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:34 2022] PUT /identity/v3/projects/ede4f988c076470ab3b0255b4da0d013/users/e8ae860c885c453ab71c49794c0e2a21/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:35.118594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:35.118898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:35.119148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:35.200075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] MFA Rules not processed for user `e8ae860c885c453ab71c49794c0e2a21`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:35.209263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:35.374395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:35.376243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:35.526996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 889/1775] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:35.537354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:35.544532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:35.666397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319372-9037-4fca-b2a3-c4ea6354efbd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:35.691998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:35.693706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:35.700037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:35.700037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] PATH_INFO: `/v3/projects/65a882e2595c420ab92a5e88d8878b61` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:35.704314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a882e2595c420ab92a5e88d8878b61)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:35.715812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:35.809673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78ef7-53b1-480b-a080-cee832bc6499 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:35.836661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:35.836661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:35.836927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:35.839671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:35.840216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:35.842564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:35.898992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:35.907031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a882e2595c420ab92a5e88d8878b61', 'request_id': 'req-8e756aca-e950-4c52-881c-f1249d87fb52'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:35.961698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a882e2595c420ab92a5e88d8878b61', 'request_id': 'req-8e756aca-e950-4c52-881c-f1249d87fb52'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:35.989428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 890/1776] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:35 2022] POST /identity/v3/projects => generated 379 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:35.990456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:35.992681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a882e2595c420ab92a5e88d8878b61', 'request_id': 'req-8e756aca-e950-4c52-881c-f1249d87fb52'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:36.043479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] The token cache is being invalidate because project 65a882e2595c420ab92a5e88d8878b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:36.043785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:36.056944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8e756aca-e950-4c52-881c-f1249d87fb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:36.061290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 887/1777] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:35 2022] DELETE /identity/v3/projects/65a882e2595c420ab92a5e88d8878b61 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:36.068437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.068712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.080881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.166806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:36.168057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.279183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957f3b-7856-4d2e-b13b-b58d9b2848f1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:36.321870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:36.322801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.323089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.323421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.324145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:36.337243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad841a-41b6-472d-946f-6d99ac508921 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:36.409388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 891/1778] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:35 2022] POST /identity/v3/users => generated 296 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:36.410770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.411059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.411335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.468633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 888/1779] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:36.470394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:36.476092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.492621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ae67-d393-438b-83ab-0beead030ab6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:36.500577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:36.501514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.501978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.502390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.503268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:36.506478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d98621-3b8e-478b-bd2a-9c315721f447 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:36.528440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 889/1780] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:36.533296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.533997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.534537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.569814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:36.571558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.590148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 890/1781] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:36.591779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:36.612096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722238-5f3d-4711-af17-f24f96ca6afe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:36.623403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:36.624164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.624528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.624987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] PATH_INFO: `/v3/projects/fa786ac993e140b1829ad69706ed2e9c/users/9362ce6fb1184acb8af724b839393d5c/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.660736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa786ac993e140b1829ad69706ed2e9c, user_id=9362ce6fb1184acb8af724b839393d5c, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:36.665342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:36.689041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:36.690305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.731407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 891/1782] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:36 2022] PUT /identity/v3/projects/fa786ac993e140b1829ad69706ed2e9c/users/9362ce6fb1184acb8af724b839393d5c/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:36.732641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:36.864230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17234b4-3933-44db-96aa-34e62e1d41f7 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:36.871466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:36.872177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.872539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.873645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.874514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:36.874883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:36.876740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:36.955576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:36.958717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 892/1783] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:36.972852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:36.999781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 892/1784] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:37.000666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.011488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad5a2-63c6-4884-8813-5ba331c173d9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.030401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.030401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.030401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.030401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.030772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.030772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.030937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98433-2484-47e6-a189-e2a8f23a8410 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.068206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 893/1785] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:37.069768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.071767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.072052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.072598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.073310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.073996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.081601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.103073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba0094-52e0-4cb8-9d82-02317b2b9d4d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.126235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.127377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.128279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.129579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] PATH_INFO: `/v3/projects/fa786ac993e140b1829ad69706ed2e9c/users/9362ce6fb1184acb8af724b839393d5c/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.145314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 893/1786] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:36 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:37.147879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa786ac993e140b1829ad69706ed2e9c, user_id=9362ce6fb1184acb8af724b839393d5c, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.148660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.156124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945715a-9618-492a-8f0c-4a95279f9e5a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.223592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 894/1787] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:37 2022] PUT /identity/v3/projects/fa786ac993e140b1829ad69706ed2e9c/users/9362ce6fb1184acb8af724b839393d5c/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:37.233303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6724-0ab9-4a6a-a078-fbb7d055162a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.243650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.244017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.244193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.286190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:37.308806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.309572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.309851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.310121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.310983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.338252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.385872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 894/1788] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:37 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:37.386710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.391712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:37.440650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] MFA Rules not processed for user `9362ce6fb1184acb8af724b839393d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:37.462976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:37.569535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:37.675693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561a1e-cf1a-4b44-8ba4-e286de04fd39 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.695977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.697524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.698489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.699569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.805212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 895/1789] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:37.805967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.834522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742adf07-2f16-4390-97fb-a8313f2e0568 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.847339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.850429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.852016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.852312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.855371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.859871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.889659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 896/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:37.891202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.913168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411e1f3-6994-4a69-aaa8-dd837d62fee0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:37.927453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:37.928360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:37.928643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:37.932983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:37.934238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.940712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.946263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:37.953852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647da104-a490-4158-8cec-f217bae16e2e service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:37.968707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 897/1791] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:37.974833 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:37.995186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 895/1792] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:49:38.004453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3c43e-705c-47a1-bcc4-25bb5bb454e3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:38.033517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:38.034422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:38.035013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:38.035619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] PATH_INFO: `/v3/projects/6814c98c00f347e4a5d8a9375e201354/users/5448c91c7baa4fd985a1cc0624276444/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:38.117576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6814c98c00f347e4a5d8a9375e201354, user_id=5448c91c7baa4fd985a1cc0624276444, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:38.133884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:38.183579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:38.183856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:38.184125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:38.184580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 898/1793] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:37 2022] PUT /identity/v3/projects/6814c98c00f347e4a5d8a9375e201354/users/5448c91c7baa4fd985a1cc0624276444/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:38.186979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:38.195213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:38.298392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] MFA Rules not processed for user `5448c91c7baa4fd985a1cc0624276444`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:38.304491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:38.478610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6393a-1a8c-4887-ac3d-3ec37e35a54f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:38.492748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:38.494456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:38.494912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:38.495836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:38.500280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:38.740295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:38.745198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 896/1794] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:38.747055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:38.760264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:38.763388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:38.820660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 899/1795] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:39.025428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1086-90b5-49dd-b47a-7ca68915dc55 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:39.048511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:39.051968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.052552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.054306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.055372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:39.060600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:39.117558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:39.138389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 897/1796] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:38 2022] POST /identity/v3/projects => generated 385 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:39.141990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:39.162331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab312913-98f7-4d0e-8d7f-d80523382df0 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:39.412953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:39.414806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:39.477791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:39.478450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.478729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.495936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.499716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:39.510136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:39.643284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 900/1797] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:39 2022] POST /identity/v3/users => generated 299 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:39.654795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:39.722093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3846-bb90-4138-859c-fcfc347cab12 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:39.755538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59adf7-30aa-458b-adcf-863fd247cad3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:39.769610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:39.770411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.772263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.772561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] PATH_INFO: `/v3/users/3b5985de31ed4dccbf389ce50dd77787` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.774786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5985de31ed4dccbf389ce50dd77787)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:39.777147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:39.777788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.778079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.778348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.779092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:39.792278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:39.809736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:39.907455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 901/1798] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:39.908552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:39.999847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd511a8d-5522-4499-a1e4-9f038b271309 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:40.001903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5985de31ed4dccbf389ce50dd77787'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:40.024089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5985de31ed4dccbf389ce50dd77787'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:40.049627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5985de31ed4dccbf389ce50dd77787'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:40.053599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5985de31ed4dccbf389ce50dd77787'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:40.058136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:40.059088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.059373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.059651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] PATH_INFO: `/v3/projects/4056b0d16bc34067a9a38442d1ff776f/users/84f6e765fd9d4161870306e31dc038c6/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:40.107526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b2f9a711-1cd7-4091-b41c-552690f3bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5985de31ed4dccbf389ce50dd77787'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:40.120625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 898/1799] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:39 2022] DELETE /identity/v3/users/3b5985de31ed4dccbf389ce50dd77787 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:40.125702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.126218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.126750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:40.207780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:40.207780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:40.222043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4056b0d16bc34067a9a38442d1ff776f, user_id=84f6e765fd9d4161870306e31dc038c6, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:40.237561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:40.319311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 902/1800] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:39 2022] PUT /identity/v3/projects/4056b0d16bc34067a9a38442d1ff776f/users/84f6e765fd9d4161870306e31dc038c6/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:40.320370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:40.328213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:40.371569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 899/1801] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:40.583206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:40.585189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:40.642136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:40.740444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a835e-547c-4a99-823b-d1cd31de37d5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:40.741782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6e98-460c-415c-913f-081289c0bab2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:40.749555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:40.750221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.750500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.750775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:40.751433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:40.753794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:40.804051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 903/1802] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:40.805179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:40.861912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f335-66a6-4a60-976d-329748049c7a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:40.881101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:40.882840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.883169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.883547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] PATH_INFO: `/v3/projects/4056b0d16bc34067a9a38442d1ff776f/users/84f6e765fd9d4161870306e31dc038c6/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:40.902489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4056b0d16bc34067a9a38442d1ff776f, user_id=84f6e765fd9d4161870306e31dc038c6, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:40.915020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dcc13-bc45-43ea-bd25-dfecbd924de0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:40.933003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 904/1803] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:40 2022] PUT /identity/v3/projects/4056b0d16bc34067a9a38442d1ff776f/users/84f6e765fd9d4161870306e31dc038c6/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:40.948153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.948541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.948854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:40.949909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:40.951407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:40.952009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:40.952583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:41.007889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:41.009416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:41.090329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 900/1804] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:41.134067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] MFA Rules not processed for user `84f6e765fd9d4161870306e31dc038c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:41.135339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:41.188961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:41.316088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 905/1805] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:41.329543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:41.331653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:41.458339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:41.460447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:41.527369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ea70-1fd9-4c5b-9f88-c0fc63495ddb service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:41.656808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3de49-08eb-4c83-9d37-e7d804fcfa34 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:41.667147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:41.673004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:41.674628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:41.674891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:41.681659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:41.685532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:41.686258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:41.686584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:41.686911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:41.713344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:41.715174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c8000-146a-4fea-a5e0-e46ad806cee5 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:41.761365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 901/1806] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:41.794243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:41.794874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:41.795141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:41.860644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:41.862183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:41.880105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:41.886622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:41.944036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 906/1807] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:42.006508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:42.069550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 902/1808] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Aug 30 11:49:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:42.090863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:42.093004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:42.148631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4a8e-70af-45dc-a4b2-705168eed2fb service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:42.180781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:42.183585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.185608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.188574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:42.226553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:42.235083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fb9d-97a7-49da-affe-4eba51d4ff33 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:42.280815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 907/1809] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:42.297341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:42.299120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:42.553011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090d05-d613-4647-aa18-708d5c47da55 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:42.586668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:42.586979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.595345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.596064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] PATH_INFO: `/v3/users/7a7b63da333a4b069c11de723eca0ed2` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:42.602553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7b63da333a4b069c11de723eca0ed2)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:42.604577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:42.808133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7b63da333a4b069c11de723eca0ed2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:42.824275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7b63da333a4b069c11de723eca0ed2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:42.844101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7b63da333a4b069c11de723eca0ed2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:42.846412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7b63da333a4b069c11de723eca0ed2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:42.905319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7b63da333a4b069c11de723eca0ed2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:42.931490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 903/1810] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:42 2022] DELETE /identity/v3/users/7a7b63da333a4b069c11de723eca0ed2 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:42.937577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.938059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.938345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:43.006701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:43.013753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:43.199368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:43.251257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 908/1811] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:43.394858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:43.396478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:43.639072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe468cb-9343-4078-b61c-f320eab880c0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:43.655021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:43.656039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:43.656715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:43.657763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:43.672538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:43.675483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf1db-b3fe-4859-9f4a-7ec79d9f86b9 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:43.689791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 904/1812] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:44.259484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:44.261397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:44.286469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b4d31-3292-4c58-b417-5765a02aa5e0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:44.302357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:44.303589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:44.304098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:44.304643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] PATH_INFO: `/v3/users/5448c91c7baa4fd985a1cc0624276444` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:44.306396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5448c91c7baa4fd985a1cc0624276444)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:44.315797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:44.412794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5448c91c7baa4fd985a1cc0624276444'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:44.445382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5448c91c7baa4fd985a1cc0624276444'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:44.471256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5448c91c7baa4fd985a1cc0624276444'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:44.473250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5448c91c7baa4fd985a1cc0624276444'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:44.476040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5448c91c7baa4fd985a1cc0624276444'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:44.504654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 909/1813] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:44 2022] DELETE /identity/v3/users/5448c91c7baa4fd985a1cc0624276444 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:44.509822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc253-694e-4d3e-ae41-cf8c54591dc2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:44.513012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc253-694e-4d3e-ae41-cf8c54591dc2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:44.513346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc253-694e-4d3e-ae41-cf8c54591dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:44.560657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5ebfc253-694e-4d3e-ae41-cf8c54591dc2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:44.563265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5ebfc253-694e-4d3e-ae41-cf8c54591dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:44.578056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:44.745018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 905/1814] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:44.914328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:44.916315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.063476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac238b2-2036-468d-8a61-c1cdae22a897 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:45.076260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:45.077085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.077469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.077878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.104020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:45.105714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475d93-f20a-4e7e-b4f1-93ae04d076f5 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:45.123849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 910/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:45.346011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.346655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.347129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.351613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 906/1816] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:49:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:45.481517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.482706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.483356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.567463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:45.568740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.729551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:45.733181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.764425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 911/1817] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:45.786335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87544179-d865-45ec-81f1-9de9015e31f7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:45.802811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:45.806924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.807520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.808098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] PATH_INFO: `/v3/projects/7cb8a92c46d041be966be4f0b8b9dedd` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.809962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb8a92c46d041be966be4f0b8b9dedd)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:45.813333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:46.009255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb8a92c46d041be966be4f0b8b9dedd', 'request_id': 'req-2ed7ab11-7b6a-4553-94ca-e280249a05b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.018914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb8a92c46d041be966be4f0b8b9dedd', 'request_id': 'req-2ed7ab11-7b6a-4553-94ca-e280249a05b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.060685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb8a92c46d041be966be4f0b8b9dedd', 'request_id': 'req-2ed7ab11-7b6a-4553-94ca-e280249a05b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.114002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] The token cache is being invalidate because project 7cb8a92c46d041be966be4f0b8b9dedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:46.119543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.121379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.125038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 907/1818] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:45 2022] DELETE /identity/v3/projects/7cb8a92c46d041be966be4f0b8b9dedd => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:46.130126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:46.138975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:46.154983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423265a-a23b-44ec-bbb1-92707f6d3fd8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:46.344335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:46.356322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:46.356708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:46.357061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] PATH_INFO: `/v3/users/c23f0b62904c4309942688f0b7a706da` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:46.359137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23f0b62904c4309942688f0b7a706da)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:46.360750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:46.427789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:46.449180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:46.476526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23f0b62904c4309942688f0b7a706da'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.518230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23f0b62904c4309942688f0b7a706da'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.531542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23f0b62904c4309942688f0b7a706da'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.532502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23f0b62904c4309942688f0b7a706da'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.533235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23f0b62904c4309942688f0b7a706da'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:46.561049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 912/1819] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:46 2022] DELETE /identity/v3/users/c23f0b62904c4309942688f0b7a706da => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:46.802152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:46.803869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:46.811002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ab11-7b6a-4553-94ca-e280249a05b7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:46.875362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:47.011739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71799ed-3359-495d-9af1-37fe97e86718 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:47.015652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:47.016545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.016931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.017315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.020957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.029271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:47.031777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.032069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.033996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] PATH_INFO: `/v3/users/e8ae860c885c453ab71c49794c0e2a21` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.039004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ae860c885c453ab71c49794c0e2a21)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:47.041819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:47.043718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:47.043839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:47.089679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 908/1820] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:47.130107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:47.147491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:47.150264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.184241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417131bd-6a45-4260-8c1d-21042e4d1503 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:47.203943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ae860c885c453ab71c49794c0e2a21'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.209535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:47.211097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.211266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.211541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] PATH_INFO: `/v3/projects/21772abb09c9477faa6dc31a0e5d477a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.219991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21772abb09c9477faa6dc31a0e5d477a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:47.227376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:47.234588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ae860c885c453ab71c49794c0e2a21'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.254445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ae860c885c453ab71c49794c0e2a21'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.258059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ae860c885c453ab71c49794c0e2a21'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.259713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2923f3c2-588c-4d40-8e7b-69b7a59dc0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ae860c885c453ab71c49794c0e2a21'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.302186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 913/1821] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:46 2022] DELETE /identity/v3/users/e8ae860c885c453ab71c49794c0e2a21 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:47.307115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430f36-438b-42f4-ae36-8d9aeb701a0b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.307412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430f36-438b-42f4-ae36-8d9aeb701a0b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.307702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430f36-438b-42f4-ae36-8d9aeb701a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.361305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b7430f36-438b-42f4-ae36-8d9aeb701a0b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:47.363128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b7430f36-438b-42f4-ae36-8d9aeb701a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.459318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21772abb09c9477faa6dc31a0e5d477a', 'request_id': 'req-52ac263e-03f3-47e0-90b8-d1cf3033d418'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.484197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21772abb09c9477faa6dc31a0e5d477a', 'request_id': 'req-52ac263e-03f3-47e0-90b8-d1cf3033d418'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.536934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21772abb09c9477faa6dc31a0e5d477a', 'request_id': 'req-52ac263e-03f3-47e0-90b8-d1cf3033d418'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.561401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 914/1822] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:47.589344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] The token cache is being invalidate because project 21772abb09c9477faa6dc31a0e5d477a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:47.589772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.590712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-52ac263e-03f3-47e0-90b8-d1cf3033d418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:47.593833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 909/1823] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:47 2022] DELETE /identity/v3/projects/21772abb09c9477faa6dc31a0e5d477a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:47.599191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.599981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.600358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.627780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:47.629308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.640746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 915/1824] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:47.648097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.648718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.649129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.695634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:47.698734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.722015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 910/1825] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:47.728331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:47.745097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a700-820e-4938-966d-adb1251129f9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:47.767541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:47.769243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.769540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.769859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.773310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:47.773619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:47.778930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:47.817920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 916/1826] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:47.823945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:47.847704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825c03-6845-4c29-ad44-640ddd7ff6a2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:47.868263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:47.868263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.868263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.868263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.868572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:47.871597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:47.926773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:47.928885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:47.952344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 911/1827] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:47.957787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.104008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8dd0-fe02-4ee8-b097-234d8dfea1d4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.143584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4b64-46d0-4856-9633-f2f8150eaf0e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.150514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.151035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.151275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.151565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.152253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.161212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.185952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:48.192352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:48.210217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 912/1828] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:48.211424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.227105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb3a0-7226-4ead-b996-98afe5ac8c4e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.229629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.231062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.231578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.232251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.235450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.236815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.237686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.238114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.238390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.239119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.242305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.257374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 913/1829] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:48.263181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.266704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.268451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.276276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f493f-4bd6-4188-b593-f22c4229f276 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.288113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.290712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.291235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.291741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.293124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.306379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a407-c1c6-4412-b9cf-cc0df563588a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.309460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 917/1830] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:48.324712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 914/1831] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:48.326782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.358433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a1f3c-497f-4b3d-8c00-81903d51529b service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.370462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.371204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.371479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.371755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] PATH_INFO: `/v3/projects/b65d11d655084fc8b3d4c317f43ebb6e/users/224a10200a674906a9c9de0a98c6fe35/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.416447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65d11d655084fc8b3d4c317f43ebb6e, user_id=224a10200a674906a9c9de0a98c6fe35, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.419410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.448145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 918/1832] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:48 2022] PUT /identity/v3/projects/b65d11d655084fc8b3d4c317f43ebb6e/users/224a10200a674906a9c9de0a98c6fe35/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:48.456195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.456634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.457224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.495462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:48.497693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.703162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 915/1833] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:48.800480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.802986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.879093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.881118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.933924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7584e-09f6-4308-80b7-8be484b644d1 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.976018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.980723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.985275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.986977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] PATH_INFO: `/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.991025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c68edcc6a74ec085c4ed43b84e97a5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.997441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.041020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7203-0550-49be-8ac4-9fdc3b363519 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.049502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:49.050853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.062239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.064327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.095295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:49.102470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.121269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c68edcc6a74ec085c4ed43b84e97a5', 'request_id': 'req-a3460fd3-8459-4da6-96e4-9db705c8ace9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.131701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 919/1834] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:49.135660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:49.140271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:49.165032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c68edcc6a74ec085c4ed43b84e97a5', 'request_id': 'req-a3460fd3-8459-4da6-96e4-9db705c8ace9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.177954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15970f97-5304-4d42-b58d-eef013e83671 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.204207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c68edcc6a74ec085c4ed43b84e97a5', 'request_id': 'req-a3460fd3-8459-4da6-96e4-9db705c8ace9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.241580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] The token cache is being invalidate because project 17c68edcc6a74ec085c4ed43b84e97a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:49.244608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.248067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a3460fd3-8459-4da6-96e4-9db705c8ace9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.252717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 916/1835] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:48 2022] DELETE /identity/v3/projects/17c68edcc6a74ec085c4ed43b84e97a5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:49.258698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78c08-d17b-4d5d-aa17-04053dd7aaf0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.258998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78c08-d17b-4d5d-aa17-04053dd7aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.259946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78c08-d17b-4d5d-aa17-04053dd7aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.319320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-26c78c08-d17b-4d5d-aa17-04053dd7aaf0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:49.322089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-26c78c08-d17b-4d5d-aa17-04053dd7aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:49.426967 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:49.427859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.428309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.428779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] PATH_INFO: `/v3/projects/6814c98c00f347e4a5d8a9375e201354` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.437830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6814c98c00f347e4a5d8a9375e201354)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:49.440257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.483887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 917/1836] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:49.501872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.502205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.502518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.514802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:49.535017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:49.536941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:49.577586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6814c98c00f347e4a5d8a9375e201354', 'request_id': 'req-7bd2044a-4eee-46ad-bfed-0af5ed267349'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.604137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6814c98c00f347e4a5d8a9375e201354', 'request_id': 'req-7bd2044a-4eee-46ad-bfed-0af5ed267349'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.623761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:49.627591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6814c98c00f347e4a5d8a9375e201354', 'request_id': 'req-7bd2044a-4eee-46ad-bfed-0af5ed267349'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.645848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 918/1837] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:49.650179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:49.661440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] The token cache is being invalidate because project 6814c98c00f347e4a5d8a9375e201354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:49.661854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.664796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.666665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641958a-acee-4c21-a9ec-c63eb50ea2d6 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.672864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 920/1838] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:49 2022] DELETE /identity/v3/projects/6814c98c00f347e4a5d8a9375e201354 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:49.673067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:49.673843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:49.674510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.675443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.677362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.678741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:49.679260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:49.680083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:49.681425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.707182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 919/1839] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:49.707900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2044a-4eee-46ad-bfed-0af5ed267349 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.711735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:49.713708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:49.715933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:49.716648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.716935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.717233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] PATH_INFO: `/v3/users/84f6e765fd9d4161870306e31dc038c6` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.719004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f6e765fd9d4161870306e31dc038c6)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:49.721239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.744091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95be2b-211a-426c-a2d4-19302985dba4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.752216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:49.752688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.753002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.753289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.754218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:49.759546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:49.829375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 920/1840] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:49 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:49.834895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:49.857988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f6e765fd9d4161870306e31dc038c6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.891361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f6e765fd9d4161870306e31dc038c6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.911143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f6e765fd9d4161870306e31dc038c6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.913830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f6e765fd9d4161870306e31dc038c6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.914691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b0f6c55-bded-4891-a1db-1917bd9afe1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f6e765fd9d4161870306e31dc038c6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:49.945625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 921/1841] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:49 2022] DELETE /identity/v3/users/84f6e765fd9d4161870306e31dc038c6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:49.949078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5dd2-9529-4540-ab28-c4f785581d21 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:49.949579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5dd2-9529-4540-ab28-c4f785581d21 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:49.950793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c5dd2-9529-4540-ab28-c4f785581d21 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:49.955014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfae6-9a3e-42d1-8185-2176fafd7f49 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:49.957113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 922/1842] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:49:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:50.050379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.051601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.051751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.125277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:50.133449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:50.146255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:50.147193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.147476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.147761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.148618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:50.150977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:50.198894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 921/1843] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:49 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:50.207155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:50.210320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:50.236530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:50.266200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114dff-5c31-4ea2-beac-b97c3f3511bc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:50.280634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:50.281338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.281624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.281976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.282720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:50.286952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:50.319996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 922/1844] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:50.321711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:50.334939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 923/1845] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:49:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:50.347272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c00f6-61e6-4075-851b-ed461dab4d55 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:50.356229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:50.357160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.358284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.358666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.359640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:50.361698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2826c-9441-46d3-9e99-fe88ec05e85a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:50.381011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 923/1846] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:50.384582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:50.419463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749025ba-4ff0-4900-8810-ff871aa662fe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:50.434111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:50.436285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.438860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.439176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] PATH_INFO: `/v3/projects/39735de851e7453795888aa56abf63e1/users/a7f6fee35c0c498eb52e7491f63936cb/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.467461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39735de851e7453795888aa56abf63e1, user_id=a7f6fee35c0c498eb52e7491f63936cb, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:50.470755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:50.525932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 924/1847] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:50 2022] PUT /identity/v3/projects/39735de851e7453795888aa56abf63e1/users/a7f6fee35c0c498eb52e7491f63936cb/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:50.538525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.538843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.539171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.615730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] MFA Rules not processed for user `a7f6fee35c0c498eb52e7491f63936cb`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:50.617237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:50.727351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 924/1848] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:50.732717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:50.913454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:50.999393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d55181-0aac-44e6-92e6-39fc35964a1a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.013157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.014547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.014829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.015189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.015777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.017743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.094083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.099125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.110583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 925/1849] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:50 2022] POST /identity/v3/projects => generated 377 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:51.115062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.284557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ed59-b651-4c21-a638-8ef19b9bb0dc None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.377379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958274-7d49-47a8-9fab-11bb09ee3c42 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.393539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.408620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.419139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.423139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.425960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.436936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.463890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.464555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.464832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.465132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.489249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:51.498641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.500299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.521504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 925/1850] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:51.522686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.523739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 926/1851] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:51 2022] POST /identity/v3/users => generated 295 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:51.526604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.528125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.546770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985c42-889b-4d84-8bdd-89ffef318f3e service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.558629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.559478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.560349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb59-36f8-4b07-ac6a-5443662699ff admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.561041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.561747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] PATH_INFO: `/v3/projects/4056b0d16bc34067a9a38442d1ff776f` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.564371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4056b0d16bc34067a9a38442d1ff776f)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.567531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.571036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.571730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.572015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.572295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.574262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.577093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.592579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 927/1852] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:51.596669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.622315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0b33-8805-409a-853f-72a7483ed356 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.633759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.634470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.635226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.635226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] PATH_INFO: `/v3/projects/aed542183e634ef9bdc8c9492b4bc2da/users/ff5c4d06ea4d45cba44517abc7eb8c24/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.714057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed542183e634ef9bdc8c9492b4bc2da, user_id=ff5c4d06ea4d45cba44517abc7eb8c24, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.720185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.750193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 928/1853] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:51 2022] PUT /identity/v3/projects/aed542183e634ef9bdc8c9492b4bc2da/users/ff5c4d06ea4d45cba44517abc7eb8c24/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:51.754412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.765139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4056b0d16bc34067a9a38442d1ff776f', 'request_id': 'req-b11dc6ee-9532-403d-a985-b1fe30d98508'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:51.786677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4056b0d16bc34067a9a38442d1ff776f', 'request_id': 'req-b11dc6ee-9532-403d-a985-b1fe30d98508'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:51.802905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4056b0d16bc34067a9a38442d1ff776f', 'request_id': 'req-b11dc6ee-9532-403d-a985-b1fe30d98508'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:51.820859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] The token cache is being invalidate because project 4056b0d16bc34067a9a38442d1ff776f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:51.821983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:51.822865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b11dc6ee-9532-403d-a985-b1fe30d98508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:51.830237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 926/1854] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:51 2022] DELETE /identity/v3/projects/4056b0d16bc34067a9a38442d1ff776f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:51.840880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34d49-cf33-4e29-af4e-656605c53577 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.844213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34d49-cf33-4e29-af4e-656605c53577 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.845965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34d49-cf33-4e29-af4e-656605c53577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.891515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d7f34d49-cf33-4e29-af4e-656605c53577 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:51.892614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07c63a-e320-4991-8ed3-f070bef68819 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.892984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d7f34d49-cf33-4e29-af4e-656605c53577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.906301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.907401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.909037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 927/1855] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:51.915940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.916435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.917036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.922312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.922941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.923722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.925929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.946804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 929/1856] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:51.948488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.949867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:51.950796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.958734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.967696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:51.969238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 928/1857] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:51.972655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca24f-d536-4684-ac41-b35728f874db admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.973713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.979853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.980686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.981052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.982046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] PATH_INFO: `/v3/projects/aed542183e634ef9bdc8c9492b4bc2da/users/ff5c4d06ea4d45cba44517abc7eb8c24/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.984562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a136d6-6689-4c8b-93c1-2d22e23a57e8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.984705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed542183e634ef9bdc8c9492b4bc2da, user_id=ff5c4d06ea4d45cba44517abc7eb8c24, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.987414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea629-0d8e-455f-94c2-1a588314e829 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.000372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.001025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.001311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.001580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.002254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:52.002616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.003270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 930/1858] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:51 2022] PUT /identity/v3/projects/aed542183e634ef9bdc8c9492b4bc2da/users/ff5c4d06ea4d45cba44517abc7eb8c24/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:52.004402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.014847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.015219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.015415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.018158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 929/1859] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:49:52.022851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.034103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8abe-b4cf-4279-a929-f84153a5cca3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.077388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] MFA Rules not processed for user `ff5c4d06ea4d45cba44517abc7eb8c24`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:52.078782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.160236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.161023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.161202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.161451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.162096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.164174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.192325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 931/1860] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:52.207865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.210071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.221569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 930/1861] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:49:52.223380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.270567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:52.302908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78070-c57d-425f-9809-1868366ea762 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.308745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.309538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.310032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.310674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.311893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.314509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.331099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99657d-2137-4bda-9ff4-a414b87cc19b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.351774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 931/1862] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:52.363923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.386956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd60c-55e3-42df-ac3d-35aefaf6330c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.403401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.404108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.404549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.404826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.405686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.407319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.425755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.426845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.427675 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.428158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.434518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 932/1863] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:52.436214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.436994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.451264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfb7b-2dc2-434a-b6b0-f33a7828ed46 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.457310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.458790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.459200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.459575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.460746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.463675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.487315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 933/1864] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:52.488468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.501882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.503023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:52.518082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93979-5ac2-4584-bfde-484ace6cb08f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.523515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.523993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.524638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.525095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] PATH_INFO: `/v3/projects/ede4f988c076470ab3b0255b4da0d013` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.526770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede4f988c076470ab3b0255b4da0d013)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.529706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.539806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.541300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.553197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 932/1865] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:52.554024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.572192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cb3f9-8b42-40ac-afa0-f3a8b0f18b6c service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.583811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.584891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.585201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.585504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] PATH_INFO: `/v3/projects/839e7fb28df0493688ff1226ec6529a7/users/07033265314f402faef83901de64344e/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.604465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede4f988c076470ab3b0255b4da0d013', 'request_id': 'req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.606087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=839e7fb28df0493688ff1226ec6529a7, user_id=07033265314f402faef83901de64344e, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.609413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdb6e-d714-4d13-8bf9-703e5a88a1ed admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.611364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede4f988c076470ab3b0255b4da0d013', 'request_id': 'req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.622811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede4f988c076470ab3b0255b4da0d013', 'request_id': 'req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.629012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 933/1866] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:52 2022] PUT /identity/v3/projects/839e7fb28df0493688ff1226ec6529a7/users/07033265314f402faef83901de64344e/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:52.639347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.639754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.640091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.644187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] The token cache is being invalidate because project ede4f988c076470ab3b0255b4da0d013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:52.644588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.645476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.649395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 934/1867] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:52 2022] DELETE /identity/v3/projects/ede4f988c076470ab3b0255b4da0d013 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:52.651131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.655450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.676527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] MFA Rules not processed for user `07033265314f402faef83901de64344e`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:52.678023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.765429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbfabc-b842-4f8e-bf81-d1601bb28bc6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.777973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 934/1868] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:52.781110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:52.782973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:52.819339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:52.864667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.865498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.866412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.866800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] PATH_INFO: `/v3/users/9362ce6fb1184acb8af724b839393d5c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.868064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9362ce6fb1184acb8af724b839393d5c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.871442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.875343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acd8a6-8df8-4fb3-a1e9-770849abfffc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:52.881848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:52.882682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.883002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.883399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.884146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:52.886606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5305c-8fcc-4177-b8ca-40abf0b8107d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:52.931694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9362ce6fb1184acb8af724b839393d5c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.938542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 935/1869] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:52.939109 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:52.939384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:52.939742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:52.944492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9362ce6fb1184acb8af724b839393d5c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.961289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9362ce6fb1184acb8af724b839393d5c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.967055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9362ce6fb1184acb8af724b839393d5c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:52.997203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] MFA Rules not processed for user `224a10200a674906a9c9de0a98c6fe35`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:52.998575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.005462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9362ce6fb1184acb8af724b839393d5c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.022696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 935/1870] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:52 2022] DELETE /identity/v3/users/9362ce6fb1184acb8af724b839393d5c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:53.023857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.026432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.038524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:53.143300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 936/1871] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:53.144275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.146421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.178359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500356-b667-4935-8dae-1ab5191e68c2 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.185294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.186516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.186890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.187143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.187854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.190868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.225372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 936/1872] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:53 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:53.226824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.245215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabfde2-6fce-41da-99b4-5865ee23dcfc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.251651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.253727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.254002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.254272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.254920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.257523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.280689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 937/1873] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:53.285548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.286407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59e93-f4d5-4df9-855b-0e6cac75c101 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.293487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.295169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.295169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.295525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.296696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.298712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.301360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128502-0aba-4fe1-af46-6f15db2e5135 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.309662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.310864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.311690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.312329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] PATH_INFO: `/v3/projects/a1a8603fde134d708ebed6fff0680409/users/d5b768f39b4346eba865ed36c14376ac/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.335909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 937/1874] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:53 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:53.337136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a8603fde134d708ebed6fff0680409, user_id=d5b768f39b4346eba865ed36c14376ac, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.340026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.342347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.364144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 938/1875] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:53 2022] PUT /identity/v3/projects/a1a8603fde134d708ebed6fff0680409/users/d5b768f39b4346eba865ed36c14376ac/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:53.365315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.379516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:53.467364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df369e-86a3-4658-b6ea-d72a468160a4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.473293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.474051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.474456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.474919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.475664 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.478655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.479811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2121f-9d1e-4a65-919c-ac4dd22d1b5a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.493109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.494677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.495476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.495934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.496930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.501476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.520861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 938/1876] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:53 2022] POST /identity/v3/users => generated 308 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:53.521905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.535480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf937b13-a762-4e3a-91e3-f6b2a9971b8c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.541880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.542819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.543194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.543580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.544801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.546794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.548524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 939/1877] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:53.553541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.564530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 939/1878] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:53.565547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.566065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701ef4-4581-42c5-bed7-da08792fc626 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.573226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.574277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.574740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.575207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] PATH_INFO: `/v3/projects/a1a8603fde134d708ebed6fff0680409/users/d5b768f39b4346eba865ed36c14376ac/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.576583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43451c-76c6-425c-85f9-61f76d34582e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.578356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a8603fde134d708ebed6fff0680409, user_id=d5b768f39b4346eba865ed36c14376ac, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.582341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97b74-1009-43ab-959b-b71dbfa31e55 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.583581 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.584489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.584922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.585238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] PATH_INFO: `/v3/projects/32d8bed9ab164265956147508edfa2c8/users/143c4c53e00a4e6281c5ba7c8e1fb7da/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.602926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 940/1879] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:53 2022] PUT /identity/v3/projects/a1a8603fde134d708ebed6fff0680409/users/d5b768f39b4346eba865ed36c14376ac/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:53.605648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d8bed9ab164265956147508edfa2c8, user_id=143c4c53e00a4e6281c5ba7c8e1fb7da, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.608575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.615523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.615807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.616084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.630315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 940/1880] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:53 2022] PUT /identity/v3/projects/32d8bed9ab164265956147508edfa2c8/users/143c4c53e00a4e6281c5ba7c8e1fb7da/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:53.634481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.648129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] MFA Rules not processed for user `d5b768f39b4346eba865ed36c14376ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:53.648393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:53.649414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.747313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc826264-fc30-4125-9ab9-b7e9128085cc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.762099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.762975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.763247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.763565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.764704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.765246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 941/1881] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:53.768779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.773938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.776006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.794399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 941/1882] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:53.800033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.803142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:53.851691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7782a6-3888-4a7b-9485-e786801f15e5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.852985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82559d0-e455-4b36-8d5d-a6c2093f4391 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.857401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.858058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.858330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.858604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] PATH_INFO: `/v3/projects/fa786ac993e140b1829ad69706ed2e9c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.860547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa786ac993e140b1829ad69706ed2e9c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.862181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:53.862515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.863239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.863639 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.864037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:53.881115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:53.883772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:53.897949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 942/1883] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:53.900094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:53.918698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4cc6-18df-4dbd-9d47-57509414ec0b service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:53.924502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa786ac993e140b1829ad69706ed2e9c', 'request_id': 'req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.932637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa786ac993e140b1829ad69706ed2e9c', 'request_id': 'req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.939165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa786ac993e140b1829ad69706ed2e9c', 'request_id': 'req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.944734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:53.958054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] The token cache is being invalidate because project fa786ac993e140b1829ad69706ed2e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:53.958537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.959586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-61b7cf00-cbb8-40bb-97d8-e7d1dd3fe5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:53.962144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 942/1884] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:53 2022] DELETE /identity/v3/projects/fa786ac993e140b1829ad69706ed2e9c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:53.968799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd33d4-08ab-45ce-af4d-ed82c3127f64 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:53.971337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd33d4-08ab-45ce-af4d-ed82c3127f64 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:53.971627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd33d4-08ab-45ce-af4d-ed82c3127f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.002879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5fdd33d4-08ab-45ce-af4d-ed82c3127f64 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:54.004731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5fdd33d4-08ab-45ce-af4d-ed82c3127f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.011594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.012434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.012766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.013649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] PATH_INFO: `/v3/projects/32d8bed9ab164265956147508edfa2c8/users/143c4c53e00a4e6281c5ba7c8e1fb7da/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.032773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d8bed9ab164265956147508edfa2c8, user_id=143c4c53e00a4e6281c5ba7c8e1fb7da, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.039687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.097702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 943/1885] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:53 2022] PUT /identity/v3/projects/32d8bed9ab164265956147508edfa2c8/users/143c4c53e00a4e6281c5ba7c8e1fb7da/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:54.103343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.108851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.129452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 943/1886] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:54.129452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.129452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.129452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.164800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:54.166180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.209596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:54.235205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ce14-be89-48bf-bc89-3398a353e924 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.243028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.244857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.245738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.246344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.250326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.328677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 944/1887] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:54.331434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.337015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.338663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.345182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f545-6856-42ef-999e-6b599bb21c5f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.350450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 944/1888] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:54.352143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.353134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.353493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.354370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.355262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:54.355672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.357474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.373843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 945/1889] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:54.381710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.398988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e8f51-3c40-4b8f-a4cf-0cb8d2c87716 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.423260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.423904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.424191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.424460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.425789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.427674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.473248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 945/1890] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:54 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:54.475771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.489809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7290-13fb-49da-8a26-07c59702b27f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.592033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.593513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.593962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.594417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.595146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.597869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.633142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 946/1891] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:54 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:54.634943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.656774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793199b-a36e-4862-ba6f-e6608b7df055 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.662720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.663353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.663779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.664090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.664862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.666661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.681741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 946/1892] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:54.685801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.702641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847558-f706-4d62-8b8e-2f9855abb29d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.708181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.708898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.709307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.709696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.711379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.713159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f642-c014-4b40-8dd7-b9350222b3b7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.736308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 947/1893] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:49:54.740387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.758636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c4d8-2fd6-49b3-b1b3-e32a08f62cf7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.766350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.767022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.767929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.768290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] PATH_INFO: `/v3/projects/6bc57b88cb0a4f4b8b894a4cb00ff880/users/e9f4a2719ced462e84b723ca7ee98797/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.789023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc57b88cb0a4f4b8b894a4cb00ff880, user_id=e9f4a2719ced462e84b723ca7ee98797, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.792634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.813117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 947/1894] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:54 2022] PUT /identity/v3/projects/6bc57b88cb0a4f4b8b894a4cb00ff880/users/e9f4a2719ced462e84b723ca7ee98797/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:54.822890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.823176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.823556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.853289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.855133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.861018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] MFA Rules not processed for user `e9f4a2719ced462e84b723ca7ee98797`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:54.862827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:54.875881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:54.959935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2676-ee76-4ebe-9db2-46510466982b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.961041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 948/1895] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:54.965730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.966112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:54.967182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.967696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.968129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] PATH_INFO: `/v3/users/07033265314f402faef83901de64344e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.969468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07033265314f402faef83901de64344e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.971512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:54.978514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81728a-9d17-46b0-99db-81cabd5a1b76 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:54.983926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:54.985383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:54.985661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:54.985931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:54.986571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:54.988509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.019201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:55.033774 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 949/1896] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:54 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:55.035803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.039460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07033265314f402faef83901de64344e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:55.049300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07033265314f402faef83901de64344e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:55.059729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07033265314f402faef83901de64344e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:55.060657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07033265314f402faef83901de64344e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:55.077577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d310b55c-40e5-46d9-aca4-604bd713032c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07033265314f402faef83901de64344e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:55.086606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 948/1897] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:54 2022] DELETE /identity/v3/users/07033265314f402faef83901de64344e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:55.091852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.092211 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.097231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.121406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036e6e9-d768-48ef-940b-6c1bf216c4d4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.139453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:55.141291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.252370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 949/1898] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:55.265538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.267955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.275837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.277282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.277677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.278359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.279751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.282227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.316187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:55.320047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 950/1899] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:55 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:55.321127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.322957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.339142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b4db-ecd3-4949-9605-e83020d696ab admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.345138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.346467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.346467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.346735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.347615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.349540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.352561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61887-9c9f-484e-ba87-dbf313b49527 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.358296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.359381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.359914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.360524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.365168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 951/1900] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:55.367647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.377871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.379545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.383020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049a22-3673-415b-87a4-6eaf35a79c80 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.391909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.391909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.391909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.391909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] PATH_INFO: `/v3/projects/9053455a38a242f3a4c768dc399f06cf/users/196debc50c9a421da8e3872dc34a5dfb/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.392341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 950/1901] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:55.408046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9053455a38a242f3a4c768dc399f06cf, user_id=196debc50c9a421da8e3872dc34a5dfb, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.410986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.429850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 952/1902] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:55 2022] PUT /identity/v3/projects/9053455a38a242f3a4c768dc399f06cf/users/196debc50c9a421da8e3872dc34a5dfb/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:55.434404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.447015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9cea-8bb7-482e-a620-eb35d1baaff3 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.523661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.526757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.554770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.555944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.556233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.556512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.557223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.560368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.580515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 951/1903] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:55.584913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.605940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c9e56-7350-4a2d-8dba-9f1cf58e4923 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.612191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.613163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.613438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.613866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] PATH_INFO: `/v3/projects/9053455a38a242f3a4c768dc399f06cf/users/196debc50c9a421da8e3872dc34a5dfb/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.615896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9053455a38a242f3a4c768dc399f06cf, user_id=196debc50c9a421da8e3872dc34a5dfb, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.618569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe93a5-fa7a-4a81-962d-4a9bcd9d75d4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.632151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 952/1904] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:55 2022] PUT /identity/v3/projects/9053455a38a242f3a4c768dc399f06cf/users/196debc50c9a421da8e3872dc34a5dfb/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:55.644610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a8ba-a23a-471e-8e19-d21161858308 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.644898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a8ba-a23a-471e-8e19-d21161858308 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.645198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a8ba-a23a-471e-8e19-d21161858308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.664436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8ba1-0681-4b31-bc21-92ee3d7cd704 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.683542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c416a8ba-a23a-471e-8e19-d21161858308 None None] MFA Rules not processed for user `196debc50c9a421da8e3872dc34a5dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:55.685062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c416a8ba-a23a-471e-8e19-d21161858308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.685253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:55.749663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.750465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.750728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.750995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.757696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.826267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 953/1905] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:55.827545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.827834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.828103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.854173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.855678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:55.867140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] MFA Rules not processed for user `143c4c53e00a4e6281c5ba7c8e1fb7da`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:55.867273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 953/1906] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:55.868086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.869457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.869567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.907247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:55.959545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 954/1907] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:55.965380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:55.965380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.978046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8c4b2-3825-46c5-b73e-2dd4765ce239 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:55.982747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:55.983372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.984325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.984580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.996717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:55.999291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:56.006062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff242a-416a-4fd3-b18f-364097d39fd6 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:56.012259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 955/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:56.013240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:56.014074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:56.014530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:56.014843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] PATH_INFO: `/v3/projects/839e7fb28df0493688ff1226ec6529a7` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:56.019221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839e7fb28df0493688ff1226ec6529a7)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:56.021134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:56.134920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839e7fb28df0493688ff1226ec6529a7', 'request_id': 'req-d41c0470-2d17-46df-8a48-fea53fd52204'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.153083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839e7fb28df0493688ff1226ec6529a7', 'request_id': 'req-d41c0470-2d17-46df-8a48-fea53fd52204'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.171529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839e7fb28df0493688ff1226ec6529a7', 'request_id': 'req-d41c0470-2d17-46df-8a48-fea53fd52204'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.190929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:56.204330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] The token cache is being invalidate because project 839e7fb28df0493688ff1226ec6529a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:56.206404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.208087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.210736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 954/1909] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:55 2022] DELETE /identity/v3/projects/839e7fb28df0493688ff1226ec6529a7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:56.215328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:56.237960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a132ee3-9163-4dc1-8292-c3fb38f2376c service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:56.314643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:56.316261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:56.386060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:56.387501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:56.388497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:56.388836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] PATH_INFO: `/v3/users/d5b768f39b4346eba865ed36c14376ac` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:56.393377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b768f39b4346eba865ed36c14376ac)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:56.395636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:56.507353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0470-2d17-46df-8a48-fea53fd52204 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:56.527153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:56.529269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:56.530907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:56.531560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] PATH_INFO: `/v3/users/e9f4a2719ced462e84b723ca7ee98797` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:56.533498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f4a2719ced462e84b723ca7ee98797)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:56.534157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b768f39b4346eba865ed36c14376ac'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.537608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:56.564332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b768f39b4346eba865ed36c14376ac'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.581424 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b768f39b4346eba865ed36c14376ac'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.582543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b768f39b4346eba865ed36c14376ac'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.623506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8323ba5e-f6e9-4c09-bb85-9119d2080afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b768f39b4346eba865ed36c14376ac'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.636317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 956/1910] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:56 2022] DELETE /identity/v3/users/d5b768f39b4346eba865ed36c14376ac => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:56.655438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f4a2719ced462e84b723ca7ee98797'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.671410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f4a2719ced462e84b723ca7ee98797'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.679968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f4a2719ced462e84b723ca7ee98797'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.680837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f4a2719ced462e84b723ca7ee98797'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.681476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f4a2719ced462e84b723ca7ee98797'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:56.700793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 955/1911] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:56 2022] DELETE /identity/v3/users/e9f4a2719ced462e84b723ca7ee98797 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:49:56.708102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5965-7694-46b0-8773-91650156bc79 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:56.708720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5965-7694-46b0-8773-91650156bc79 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:56.709367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5965-7694-46b0-8773-91650156bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:56.742061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f97c5965-7694-46b0-8773-91650156bc79 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:56.743707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f97c5965-7694-46b0-8773-91650156bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:56.795427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:56.845366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 957/1912] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:56.887671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:56.889201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:57.002088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a951-edfa-4854-849e-dd4713bfd35a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:57.007652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:57.009210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:57.009210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:57.009210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:57.028996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:57.031523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537e945-1521-4036-b736-e26da09e3eca service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:57.070247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 956/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:57.206491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:57.207176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:57.208227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:57.210203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 958/1914] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:57.228015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:57.229529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:57.230529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:57.269555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:57.272009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:57.302130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:57.378466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 957/1915] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:57.401191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:57.406990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:57.445674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a530608-7698-4506-8407-999b6978f4b3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:57.454357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:57.455449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:57.455799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:57.456135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:57.467974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:57.470978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:57.485054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 959/1916] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:57.923772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:57.925576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:57.958595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf69eb-3c26-4faf-a0be-edca004833ea None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:57.970579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:57.971048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:57.971391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:57.971890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] PATH_INFO: `/v3/projects/a1a8603fde134d708ebed6fff0680409` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:57.973780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a8603fde134d708ebed6fff0680409)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:57.981939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.082750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a8603fde134d708ebed6fff0680409', 'request_id': 'req-4c3c9a30-f4d8-44da-bd7d-4406233667b5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.093911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a8603fde134d708ebed6fff0680409', 'request_id': 'req-4c3c9a30-f4d8-44da-bd7d-4406233667b5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.102022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a8603fde134d708ebed6fff0680409', 'request_id': 'req-4c3c9a30-f4d8-44da-bd7d-4406233667b5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.122625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.125541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.130783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] The token cache is being invalidate because project a1a8603fde134d708ebed6fff0680409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:58.132480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.133875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c3c9a30-f4d8-44da-bd7d-4406233667b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.142300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 958/1917] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:57 2022] DELETE /identity/v3/projects/a1a8603fde134d708ebed6fff0680409 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:58.142492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5bda-b1d2-4e6e-b699-dcf9e226bfc5 service placement] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.148159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec577c-d443-4bda-b4f0-636293ba5531 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.149010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec577c-d443-4bda-b4f0-636293ba5531 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.149470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec577c-d443-4bda-b4f0-636293ba5531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.180409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-dfec577c-d443-4bda-b4f0-636293ba5531 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:58.181701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dfec577c-d443-4bda-b4f0-636293ba5531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.245899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.247084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.247807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.248807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] PATH_INFO: `/v3/users/224a10200a674906a9c9de0a98c6fe35` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.251065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=224a10200a674906a9c9de0a98c6fe35)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.253567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.326056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 959/1918] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:58.337591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.339156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.339478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.381946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224a10200a674906a9c9de0a98c6fe35'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.391335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:58.393478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.394920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224a10200a674906a9c9de0a98c6fe35'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.404744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224a10200a674906a9c9de0a98c6fe35'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.405570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224a10200a674906a9c9de0a98c6fe35'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.411012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 960/1919] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:58.412483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.422732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224a10200a674906a9c9de0a98c6fe35'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.425280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f5835-b629-48ad-b887-181271ae8a25 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.437214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 960/1920] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:58 2022] DELETE /identity/v3/users/224a10200a674906a9c9de0a98c6fe35 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:58.455508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.456454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.457439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.457828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.458713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:49:58.459096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.463636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.483635 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 961/1921] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:49:58.484861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.490100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.567925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:58.601272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b69dd-3f40-47c6-b637-66a0a043ad2e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.609988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.610777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.611185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.611526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.612266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.614676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.650363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 961/1922] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:49:58 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:58.656108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.670962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f3303-a4c3-45a0-ab4e-51a24cbc06a0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.682459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.684671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.692927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:58.756008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.756665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.756924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.757242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.757924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.760171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.789836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 962/1923] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:49:58 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:49:58.791139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.793957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.808020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bd32e-21d3-473a-8b9c-4da9f586afa0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.814381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.815029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.815306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.816024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] PATH_INFO: `/v3/projects/b65d11d655084fc8b3d4c317f43ebb6e` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.817311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65d11d655084fc8b3d4c317f43ebb6e)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.819160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.819654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ff2c-d435-4ed6-b371-ca57ac083d54 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:58.824413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:58.825214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:58.825548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:58.825827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] PATH_INFO: `/v3/projects/6bc57b88cb0a4f4b8b894a4cb00ff880` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:58.827060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc57b88cb0a4f4b8b894a4cb00ff880)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:58.829006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:58.879849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65d11d655084fc8b3d4c317f43ebb6e', 'request_id': 'req-491246f6-d2f2-40fa-b985-e5c1ba9d6215'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.887705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65d11d655084fc8b3d4c317f43ebb6e', 'request_id': 'req-491246f6-d2f2-40fa-b985-e5c1ba9d6215'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.892501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc57b88cb0a4f4b8b894a4cb00ff880', 'request_id': 'req-c3a04496-1343-45b2-822e-c4f5bd2bb711'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.894325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65d11d655084fc8b3d4c317f43ebb6e', 'request_id': 'req-491246f6-d2f2-40fa-b985-e5c1ba9d6215'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.899205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc57b88cb0a4f4b8b894a4cb00ff880', 'request_id': 'req-c3a04496-1343-45b2-822e-c4f5bd2bb711'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.907731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc57b88cb0a4f4b8b894a4cb00ff880', 'request_id': 'req-c3a04496-1343-45b2-822e-c4f5bd2bb711'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.909987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] The token cache is being invalidate because project b65d11d655084fc8b3d4c317f43ebb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:58.910523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.911190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.912954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 963/1924] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:58 2022] DELETE /identity/v3/projects/b65d11d655084fc8b3d4c317f43ebb6e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:58.913539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.916994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:58.923979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] The token cache is being invalidate because project 6bc57b88cb0a4f4b8b894a4cb00ff880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:58.924272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.925094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:58.926856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 962/1925] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:58 2022] DELETE /identity/v3/projects/6bc57b88cb0a4f4b8b894a4cb00ff880 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:58.929765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:58.931170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.018958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491246f6-d2f2-40fa-b985-e5c1ba9d6215 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.055367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.059560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04496-1343-45b2-822e-c4f5bd2bb711 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.067413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.068273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.069896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.070176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] PATH_INFO: `/v3/users/143c4c53e00a4e6281c5ba7c8e1fb7da` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.072102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=143c4c53e00a4e6281c5ba7c8e1fb7da)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.074228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.082057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.137657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.139539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.139884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.140427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.142502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.146174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.156601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143c4c53e00a4e6281c5ba7c8e1fb7da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.172273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143c4c53e00a4e6281c5ba7c8e1fb7da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.176824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 964/1926] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:59.176824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:59.179250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.189020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143c4c53e00a4e6281c5ba7c8e1fb7da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.190576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143c4c53e00a4e6281c5ba7c8e1fb7da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.195796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cfd7f-37f5-4e18-addc-3341e57d3a85 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.202225 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.204150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.204436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.205078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] PATH_INFO: `/v3/users/196debc50c9a421da8e3872dc34a5dfb` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.206596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196debc50c9a421da8e3872dc34a5dfb)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.209077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.223105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143c4c53e00a4e6281c5ba7c8e1fb7da'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.237243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 963/1927] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:58 2022] DELETE /identity/v3/users/143c4c53e00a4e6281c5ba7c8e1fb7da => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:59.238231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:59.240074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.338355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196debc50c9a421da8e3872dc34a5dfb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.364804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196debc50c9a421da8e3872dc34a5dfb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.401108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196debc50c9a421da8e3872dc34a5dfb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.404168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196debc50c9a421da8e3872dc34a5dfb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.405061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196debc50c9a421da8e3872dc34a5dfb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.442750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 965/1928] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:49:59 2022] DELETE /identity/v3/users/196debc50c9a421da8e3872dc34a5dfb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:59.488962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc94b-52d2-4150-8a04-31a395b62e9f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.588930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:59.591859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.664578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.665375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.665748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.666218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.667494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.669634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.701196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 964/1929] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:49:59.702861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:59.711014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.723406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b890-a749-4d65-bf1a-e50680ebd4f0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.730533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.731726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.732118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.732459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] PATH_INFO: `/v3/projects/32d8bed9ab164265956147508edfa2c8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.733886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d8bed9ab164265956147508edfa2c8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.736800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.744587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48011b0c-612b-4fb4-8903-8388a3fa0118 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.760731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.761812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.762615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.762796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] PATH_INFO: `/v3/projects/557bef0a240e47deb5a40b813b35699c/users/8921a532e7de48d5a432307b209a4fec/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.789907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557bef0a240e47deb5a40b813b35699c, user_id=8921a532e7de48d5a432307b209a4fec, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.793675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0a45-2f6d-4ec8-9d54-b232be44ab56 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.796652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.844808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 965/1930] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:49:59 2022] PUT /identity/v3/projects/557bef0a240e47deb5a40b813b35699c/users/8921a532e7de48d5a432307b209a4fec/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:59.849985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d8bed9ab164265956147508edfa2c8', 'request_id': 'req-e7c9d705-0e1e-446c-9c6e-087cb5920c68'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.851444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.858380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e90cc-18c1-49a7-a026-44d6758bcea3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.859477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e90cc-18c1-49a7-a026-44d6758bcea3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.860102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e90cc-18c1-49a7-a026-44d6758bcea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.864825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d8bed9ab164265956147508edfa2c8', 'request_id': 'req-e7c9d705-0e1e-446c-9c6e-087cb5920c68'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.893327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d8bed9ab164265956147508edfa2c8', 'request_id': 'req-e7c9d705-0e1e-446c-9c6e-087cb5920c68'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.919227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] The token cache is being invalidate because project 32d8bed9ab164265956147508edfa2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:49:59.919535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.922239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e7c9d705-0e1e-446c-9c6e-087cb5920c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:49:59.930011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 966/1931] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:49:59 2022] DELETE /identity/v3/projects/32d8bed9ab164265956147508edfa2c8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:49:59.931747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6d2d-50f3-4fa0-8520-27017ab30162 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.932032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6d2d-50f3-4fa0-8520-27017ab30162 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.932312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6d2d-50f3-4fa0-8520-27017ab30162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.937585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2f6e90cc-18c1-49a7-a026-44d6758bcea3 None None] MFA Rules not processed for user `8921a532e7de48d5a432307b209a4fec`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:59.938800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2f6e90cc-18c1-49a7-a026-44d6758bcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.997039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7ccc6d2d-50f3-4fa0-8520-27017ab30162 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:59.999161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7ccc6d2d-50f3-4fa0-8520-27017ab30162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.076337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 966/1932] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:00.077613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.077986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.078633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.080705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 967/1933] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:00.089716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.091608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.146421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 967/1934] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:00.155417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c71b-a50b-424a-93b9-e1c8836bf27c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.155717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c71b-a50b-424a-93b9-e1c8836bf27c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.156034 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c71b-a50b-424a-93b9-e1c8836bf27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.190972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9e63c71b-a50b-424a-93b9-e1c8836bf27c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:00.192159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9e63c71b-a50b-424a-93b9-e1c8836bf27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.211407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 968/1935] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:00.211407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.211407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.211407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.218333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89440-d3ba-4c27-aa7c-b0c59c06583b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.241231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.241904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:00.242917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.243726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.244489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.245734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.261691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.268454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.309170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 968/1936] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:00.309170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.309170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.317652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75480-fcf1-4302-b386-a12aa85290e2 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.323290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.324241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.324532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.324810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] PATH_INFO: `/v3/users/fd27a27abb20406181cbc6de51f36457` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.326862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd27a27abb20406181cbc6de51f36457)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.330379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.359156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 969/1937] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:00.360334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.372364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817eb32-81b7-4961-bf89-ee72e1267910 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.388020 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd27a27abb20406181cbc6de51f36457'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.388770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.389853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.390139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.390411 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.391078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:00.391383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.393275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.398798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd27a27abb20406181cbc6de51f36457'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.406874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd27a27abb20406181cbc6de51f36457'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.411163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd27a27abb20406181cbc6de51f36457'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.411300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 970/1938] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:00.411300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.411605 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.424577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd27a27abb20406181cbc6de51f36457'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.426261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b4e5-7618-4087-a424-075a48f3224d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.426386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:00.434217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 969/1939] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:00 2022] DELETE /identity/v3/users/fd27a27abb20406181cbc6de51f36457 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:00.438535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.440843 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.441053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.441724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.442165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.442660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] PATH_INFO: `/v3/projects/9053455a38a242f3a4c768dc399f06cf` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.443837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9053455a38a242f3a4c768dc399f06cf)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.445954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.523259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:00.527077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fc360-68ee-43f8-9d6b-f7298cdea831 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.528796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9053455a38a242f3a4c768dc399f06cf', 'request_id': 'req-f9b43c07-c5bd-4ccf-813f-b3266259a350'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.546402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9053455a38a242f3a4c768dc399f06cf', 'request_id': 'req-f9b43c07-c5bd-4ccf-813f-b3266259a350'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.554147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9053455a38a242f3a4c768dc399f06cf', 'request_id': 'req-f9b43c07-c5bd-4ccf-813f-b3266259a350'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.579413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] The token cache is being invalidate because project 9053455a38a242f3a4c768dc399f06cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:00.580288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.581168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.583622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 971/1940] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:00 2022] DELETE /identity/v3/projects/9053455a38a242f3a4c768dc399f06cf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:00.585452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.588671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.617546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.618636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.618942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.619231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] PATH_INFO: `/v3/users/8921a532e7de48d5a432307b209a4fec` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.620609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8921a532e7de48d5a432307b209a4fec)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.623333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.679315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8921a532e7de48d5a432307b209a4fec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.682534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43c07-c5bd-4ccf-813f-b3266259a350 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.688907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.689552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.689835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.689937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8921a532e7de48d5a432307b209a4fec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.690270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.692113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.697723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8921a532e7de48d5a432307b209a4fec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.698389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8921a532e7de48d5a432307b209a4fec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.706520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.708052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.712548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9ed5a737-529f-4d3a-8ed6-5eae48b984e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8921a532e7de48d5a432307b209a4fec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:00.720596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 972/1941] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:00.721364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.723304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.724149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 970/1942] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:00 2022] DELETE /identity/v3/users/8921a532e7de48d5a432307b209a4fec => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:00.725792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245665-16ef-4b35-aa04-be3f02be03ca None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.726089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245665-16ef-4b35-aa04-be3f02be03ca None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.726518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245665-16ef-4b35-aa04-be3f02be03ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.738336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ef0c0-1bca-42f2-a248-e7825b682cde service nova] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:00.753024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-09245665-16ef-4b35-aa04-be3f02be03ca None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:00.754400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-09245665-16ef-4b35-aa04-be3f02be03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.784694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:00.816332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:00.816959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.817263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.817548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.818199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:00.820114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b48157-a97a-4b28-9e36-3d0426983703 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:00.844804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 971/1943] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:00.846347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.846681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.848320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.870488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 973/1944] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:00.872264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:00.872694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:00.873203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:00.875997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:00.879463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.903880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:00.907785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:00.991216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:00.993484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 972/1945] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:00.994869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:00.996487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.038888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 974/1946] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:01.039981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.041935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.062639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc344-777c-4107-8cec-43f2a25aa04b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.068534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.069766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.070147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.070571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.071524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.075406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4762f-4640-491c-bfc3-de4b85863ffd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.107623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 975/1947] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:01.110251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.111016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.111558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.144846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:01.147580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.163825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 976/1948] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:01.163825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.164107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.175127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c8b4-e5af-4831-b78b-43f4e988f408 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.183620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166abf5-1952-4307-9f80-a30403ad1851 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.184259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.185481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.186278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.187685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.189360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.190148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.190459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.191055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.205175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.205898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.206894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.207731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.223650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 973/1949] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:01.224507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.225387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 977/1950] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:01.226371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.234105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa046d-101d-4fc3-99cd-84397e42c552 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.238599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd057cb-5cde-4474-a513-9f98ca8852c9 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.239402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.240012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.240291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.240562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.241234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.242971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.256354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.256354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.256354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.256354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.256872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:01.256872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.256872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.258156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 974/1951] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:01.261040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.267763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 978/1952] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:01.272906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.276157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e42e3-e710-41d3-88c2-96118eeeeaff admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.283636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.284367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.284766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.285171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.285906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.286016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cdadd-422f-4c5c-873d-5bb7192a6c3c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.287700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.295966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.297187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.297996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.298606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.300014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.303321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.305243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 975/1953] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:01.306240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.318927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920db33-fe14-4061-83a1-39ee849f647b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.333727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.333727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.333727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.333727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] PATH_INFO: `/v3/projects/ef5b91303be84ebfa823ae1cf9f805bf/users/cb4a73af888d4efb955a3a89f745d86c/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.346881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5b91303be84ebfa823ae1cf9f805bf, user_id=cb4a73af888d4efb955a3a89f745d86c, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.351217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5ebd-a282-479b-acf3-0ed635af9ada admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.356734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 979/1954] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:01.362298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.378483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 976/1955] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:01 2022] PUT /identity/v3/projects/ef5b91303be84ebfa823ae1cf9f805bf/users/cb4a73af888d4efb955a3a89f745d86c/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:01.389593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.389761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.390032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.423687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] MFA Rules not processed for user `cb4a73af888d4efb955a3a89f745d86c`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:01.425261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.436192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:01.473802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879acf0-5b23-4f79-968a-a2a0aad58e93 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.517313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 977/1956] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:01.518408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.550498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.551557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.551557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.551780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.552372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.554417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.586378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 980/1957] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:01.590192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.597111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaa858-16a8-4f82-8331-cb17f1f83357 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.603627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.604677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be86d-ada8-471a-a139-fab98e663a2c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.604798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.605058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.605337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.606066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.608157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.613374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.614389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.614802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.615202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.615978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.619366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.623796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:01.640483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 981/1958] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:01.644269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.656567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 978/1959] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:01.657556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.663762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098723-3cd5-4000-8a08-788b11b25e43 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.740997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658d99-9d5c-4a4d-907c-f4a8a913c323 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.756532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.757995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.757995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.757995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.758685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.760851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.794102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 979/1960] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:01 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:01.795025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.796583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.801945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.802614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.802898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.803213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.803934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.805494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.811104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e933ab-3258-4ccf-a3d4-9ec20c6819bc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.816677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.820572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 982/1961] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:01.820740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.820740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.820740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] PATH_INFO: `/v3/projects/557bef0a240e47deb5a40b813b35699c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.820996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.821762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557bef0a240e47deb5a40b813b35699c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.823724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.832001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f6e10-7d1c-4ab3-b1ea-bd90ace47968 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.837111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.837727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.838010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.838284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.838932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.840569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.858357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:01.863071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 983/1962] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:01.868279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.880916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9d5e-f8cb-4a8a-a589-fc7046b6d627 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:01.892770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557bef0a240e47deb5a40b813b35699c', 'request_id': 'req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:01.899236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557bef0a240e47deb5a40b813b35699c', 'request_id': 'req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:01.909510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557bef0a240e47deb5a40b813b35699c', 'request_id': 'req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:01.922823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] The token cache is being invalidate because project 557bef0a240e47deb5a40b813b35699c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:01.923108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:01.923756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:01.925305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 980/1963] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:01 2022] DELETE /identity/v3/projects/557bef0a240e47deb5a40b813b35699c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:01.928803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.928803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.943147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:01.943823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:01.944100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:01.944377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] PATH_INFO: `/v3/projects/c6cfcc33cc734abe8ebc95b4e5201e0c/users/14886b6fbbce41c18c7aad9ab8b0e2eb/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:01.960708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cfcc33cc734abe8ebc95b4e5201e0c, user_id=14886b6fbbce41c18c7aad9ab8b0e2eb, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:01.963317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:01.976723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 984/1964] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:01 2022] PUT /identity/v3/projects/c6cfcc33cc734abe8ebc95b4e5201e0c/users/14886b6fbbce41c18c7aad9ab8b0e2eb/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:01.977854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:01.979379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:01.998849 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f9d0-96d6-4015-9b0e-6d537366d3b6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.047107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133552c7-6b56-42f9-a5ff-2b19b7135ed4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.055923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.057188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.057188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.057454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] PATH_INFO: `/v3/projects/c68272d3252940129cb720505a228160/users/d253ca9f85d0492492609383d4f8dc34/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.069977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.070715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.071062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.071404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] PATH_INFO: `/v3/projects/f751c2b721cf487eb6c51071b172391d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.071797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:02.072646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f751c2b721cf487eb6c51071b172391d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.074879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.077533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68272d3252940129cb720505a228160, user_id=d253ca9f85d0492492609383d4f8dc34, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.080907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b42b-4159-482c-bb8c-cdceb5304248 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.098084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 985/1965] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:01 2022] PUT /identity/v3/projects/c68272d3252940129cb720505a228160/users/d253ca9f85d0492492609383d4f8dc34/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:02.099803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.100276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.100614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.124131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:02.125434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.132837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f751c2b721cf487eb6c51071b172391d', 'request_id': 'req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.139110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f751c2b721cf487eb6c51071b172391d', 'request_id': 'req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.151122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:02.151122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f751c2b721cf487eb6c51071b172391d', 'request_id': 'req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.162805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] The token cache is being invalidate because project f751c2b721cf487eb6c51071b172391d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:02.163105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.163803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-bbaeb782-b57a-4d7d-955f-bfbef6f62bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.165720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 981/1966] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:01 2022] DELETE /identity/v3/projects/f751c2b721cf487eb6c51071b172391d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:02.166683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5542c-203c-4359-b211-617e19bf2450 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.166974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5542c-203c-4359-b211-617e19bf2450 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.167243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5542c-203c-4359-b211-617e19bf2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.199507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a0e5542c-203c-4359-b211-617e19bf2450 None None] MFA Rules not processed for user `14886b6fbbce41c18c7aad9ab8b0e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:02.201023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 986/1967] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:02.201988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.203402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.209357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a0e5542c-203c-4359-b211-617e19bf2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.215572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6869a-0c28-49da-ad60-3699c81b0eb3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.220837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.221556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.221925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.222257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.222966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.224648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.239052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 987/1968] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:02.239052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.242404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.257731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bf01-10e6-43a1-8696-02da7cdbb0f8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.264082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.265434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.265726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.266007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] PATH_INFO: `/v3/users/803eb112b23740a4952d9b9d5d355632` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.269340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] RBAC: Authorizing `identity:delete_user(user_id=803eb112b23740a4952d9b9d5d355632)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.273902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.306077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 982/1969] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:02.306077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.306077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.306077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.328593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:02.330456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.351296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 983/1970] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:02.352155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.359503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803eb112b23740a4952d9b9d5d355632'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.366378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096b4a4-3c35-4092-b666-5a189feddbda None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.375086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.375795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.376068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.376343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] PATH_INFO: `/v3/projects/c68272d3252940129cb720505a228160/users/d253ca9f85d0492492609383d4f8dc34/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.379037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68272d3252940129cb720505a228160, user_id=d253ca9f85d0492492609383d4f8dc34, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.389107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.390948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803eb112b23740a4952d9b9d5d355632'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.401591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803eb112b23740a4952d9b9d5d355632'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.402458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803eb112b23740a4952d9b9d5d355632'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.403093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803eb112b23740a4952d9b9d5d355632'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:02.404685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 984/1971] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:02 2022] PUT /identity/v3/projects/c68272d3252940129cb720505a228160/users/d253ca9f85d0492492609383d4f8dc34/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:02.406013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.416348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.436259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 988/1972] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:02 2022] DELETE /identity/v3/users/803eb112b23740a4952d9b9d5d355632 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:02.437860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.439676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.501923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803835-a3be-4d32-87fc-a86087f63ff7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.546079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:02.569290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec9e1-1589-4f3d-b99b-32ba90dc553f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.578209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.581081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.581756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.582173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.582402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.582809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.583361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:02.583688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.583800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.584294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.585244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.585358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02026-59d3-44bc-8513-7ca26c26498f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.587810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.598560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 989/1973] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:02.599717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.600008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.600314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.605877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:02.631739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 985/1974] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:02.632889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.639716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] MFA Rules not processed for user `d253ca9f85d0492492609383d4f8dc34`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:02.641230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.716926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611195d2-2c06-40e6-9ff3-445ea99837c5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.720947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 990/1975] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:02.724595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.725595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.726280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.726674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.726831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.727454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.729504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.743210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e74e-dd43-45d3-8a88-a6081542489d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.749022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.749775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.750091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.750445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.751149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.753150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.761108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 986/1976] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:02.762314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.764110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:02.785410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 991/1977] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/users => generated 297 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:02.786349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.798754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e820c-c2a2-4d2f-92bc-c437ec02fdc8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.883331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f1c5-6f60-44b1-b216-2c9db1b2335b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.887544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.888655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.888798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.889356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.889542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.889643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.889803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.889917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.890670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.893872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.931023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 992/1978] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:02 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:02.931877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.957273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f979816-ba5c-4f00-9048-eb4cc5fadc4d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:02.975454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:02.976003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:02.976282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:02.976552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:02.977238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:02.978865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:02.990785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 993/1979] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:02.991469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:02.993232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.005271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.006740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.006874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070e235-e8cc-4dc9-8495-a8664185e8d7 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.012058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.012905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.013446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.013867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] PATH_INFO: `/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.015429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf7d4ca4a514726b2514faa2a2a8f04)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.017623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.035325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 987/1980] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:03.036216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.052311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55904d4f-b016-4197-a720-5f68dccab34d service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.061826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.062616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.063074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.063349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.065399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.067871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.082984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 988/1981] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:03.084095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.098838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06708346-f755-4122-b819-a28dfa914a68 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.107072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.108370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.108904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.109347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] PATH_INFO: `/v3/projects/861a633f30d0470a90f1361d08fff14e/users/0b9f995e2b3d436d8b7df7b32eb8784d/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.112712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:03.130310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:03.137391 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] RBAC: Authorizing `identity:create_grant(project_id=861a633f30d0470a90f1361d08fff14e, user_id=0b9f995e2b3d436d8b7df7b32eb8784d, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.143636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.164546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf7d4ca4a514726b2514faa2a2a8f04', 'request_id': 'req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:03.169581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 989/1982] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:03 2022] PUT /identity/v3/projects/861a633f30d0470a90f1361d08fff14e/users/0b9f995e2b3d436d8b7df7b32eb8784d/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:03.170838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.177929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf7d4ca4a514726b2514faa2a2a8f04', 'request_id': 'req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:03.188543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf7d4ca4a514726b2514faa2a2a8f04', 'request_id': 'req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:03.211334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] The token cache is being invalidate because project 9bf7d4ca4a514726b2514faa2a2a8f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:03.212040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:03.212582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:03.215447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 994/1983] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:02 2022] DELETE /identity/v3/projects/9bf7d4ca4a514726b2514faa2a2a8f04 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:03.221439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.223621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.274462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d6f9-7e6c-4717-9001-d05b6b3949da admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.283448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.285073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.285626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.286240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.288043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.291429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.312884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 990/1984] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:03.312884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.312884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.319221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6833c-c581-4b06-a9c9-d4b2bd4310fe admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.325195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998dfc6-3dd3-4280-a627-bf60f4c62f0c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.335103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.335746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.336003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.336537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.336911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.338540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563644ca-9ef2-4038-a3f3-412e1ff83b96 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.353322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 991/1985] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:03.353322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.353322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.353322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.372863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:03.374098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.376500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.378374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.378374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.378374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.379625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.399702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 992/1986] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:03.399702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.401750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.424473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ce109-1bbf-4225-ae34-cfdf23da31d1 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.435652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.436377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.436616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.436887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] PATH_INFO: `/v3/projects/2b9574f292a7422dbd78c74356a8a552/users/cec9c6a3564a49efbc2894027e93db9d/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.479081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9574f292a7422dbd78c74356a8a552, user_id=cec9c6a3564a49efbc2894027e93db9d, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.482419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.524892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 993/1987] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:03 2022] PUT /identity/v3/projects/2b9574f292a7422dbd78c74356a8a552/users/cec9c6a3564a49efbc2894027e93db9d/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:03.536229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.563565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.565323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025a89-b5ba-43e5-8ce9-e95717ee9890 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.589348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 995/1988] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:03.591002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e33e09-04e0-45a0-abd5-b9e230406bca None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.591347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e33e09-04e0-45a0-abd5-b9e230406bca None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.591779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e33e09-04e0-45a0-abd5-b9e230406bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.636389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c9e33e09-04e0-45a0-abd5-b9e230406bca None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:03.638177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c9e33e09-04e0-45a0-abd5-b9e230406bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.653875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534096-281e-41eb-b228-221954d8a62b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.658723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 996/1989] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:03.661096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.661096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.661096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.662987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.664917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.666007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.666255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] PATH_INFO: `/v3/projects/861a633f30d0470a90f1361d08fff14e/users/0b9f995e2b3d436d8b7df7b32eb8784d/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.673600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861a633f30d0470a90f1361d08fff14e, user_id=0b9f995e2b3d436d8b7df7b32eb8784d, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.676361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.705373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 994/1990] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:03 2022] PUT /identity/v3/projects/861a633f30d0470a90f1361d08fff14e/users/0b9f995e2b3d436d8b7df7b32eb8784d/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:03.707732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.728233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] MFA Rules not processed for user `cec9c6a3564a49efbc2894027e93db9d`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:03.738647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.760431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:03.789922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:03.842968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aab03-655d-4ffb-bc8d-f95c6cb5f0b3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.848817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.849528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.849812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.850261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.851016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:03.851357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.853162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368307e-cfc3-4a64-9491-ce7282be402b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.868880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 995/1991] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:03.870344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.870700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.871046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.904387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 997/1992] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:03.905638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.918443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4caa27-c2e4-460a-9286-408a87f8d315 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:03.924111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] MFA Rules not processed for user `0b9f995e2b3d436d8b7df7b32eb8784d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:03.925565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:03.925713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:03.926483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:03.926815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:03.927088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:03.927816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:03.929964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:03.967185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 998/1993] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:03 2022] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:03.968607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:03.970779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.022357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 996/1994] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:04.023444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.034438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55181da1-0e95-45d2-aeea-0ce49c61fb01 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.036860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ebe27-0477-475f-9190-e668bf76de2f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.038607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.039230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.039617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.039893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.109977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.110676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.110921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.111195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.111832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.113899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.118883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.120338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.130420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 999/1995] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:04.133286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.143371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114562-d296-4c1e-b42e-9abb177bd541 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.143803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 997/1996] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/users => generated 279 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:04.149738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.150176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.150808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.151314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.151742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.161858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c10ce5-7163-48c8-90da-6123daa0bc65 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.167108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.167940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.168362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.168636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.169485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.171104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.184280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 998/1997] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:04.187520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.200155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bcc6-d247-48bd-b9cb-74709809bfdc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.200804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:04.211410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.212044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.212329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.212604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.214773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.218382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.232510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 999/1998] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:04.236006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.237433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.237672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc66d78-362e-473b-95c1-a0f1554f6453 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.251441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1000/1999] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:04.262598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863402d-6f3f-43db-980a-7b775fc38608 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.269241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.269961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.270241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.270625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] PATH_INFO: `/v3/projects/0d6c4d9fba3e4faa817d67f31e707ab8/users/3c024c6d248d47b88c0fa00d581621c8/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.289760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6c4d9fba3e4faa817d67f31e707ab8, user_id=3c024c6d248d47b88c0fa00d581621c8, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.292806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.310442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:04.316994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1000/2000] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:04 2022] PUT /identity/v3/projects/0d6c4d9fba3e4faa817d67f31e707ab8/users/3c024c6d248d47b88c0fa00d581621c8/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:04.329327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.330098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.330381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.391928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] MFA Rules not processed for user `3c024c6d248d47b88c0fa00d581621c8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:04.393337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.523113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.524205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1001/2001] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:04.599975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbcc4-23fb-4a93-9333-f6266449aaca admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.609730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.610524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.610925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.611225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.612067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.614203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.648556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1001/2002] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/projects => generated 357 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:04.652662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.663999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6a0fe-5cec-4518-9268-b25c0b2a2729 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.737739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.738629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.739700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.739700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.739908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.741914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.762272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.768046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1002/2003] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:04.772062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.776139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13d11-682c-4fb3-8065-5816be307b21 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.783586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62248e-0d10-4cc2-b4b6-73ca8c04dcef admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.783951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.784641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.784894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.785189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] PATH_INFO: `/v3/users/14886b6fbbce41c18c7aad9ab8b0e2eb` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.786325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14886b6fbbce41c18c7aad9ab8b0e2eb)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.788247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.790092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.790712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.792365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.792365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.792365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.794324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.809152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1003/2004] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:04.811302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.823973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c92ee-abff-4003-8d23-2151973fb59f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.831372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.832082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.832945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.833257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] PATH_INFO: `/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1/users/7d63018407954df28f60d51a24b2e966/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.856089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14886b6fbbce41c18c7aad9ab8b0e2eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:04.866145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368ad516259a401ab6a7cf56e2e3d5f1, user_id=7d63018407954df28f60d51a24b2e966, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.869114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14886b6fbbce41c18c7aad9ab8b0e2eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:04.869710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.880197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14886b6fbbce41c18c7aad9ab8b0e2eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:04.881247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14886b6fbbce41c18c7aad9ab8b0e2eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:04.892260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1004/2005] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:04 2022] PUT /identity/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1/users/7d63018407954df28f60d51a24b2e966/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:04.896742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.899696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.900601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ca6cfd52-57b1-4762-b4d6-c69e0164d35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14886b6fbbce41c18c7aad9ab8b0e2eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:04.908825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1002/2006] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:04 2022] DELETE /identity/v3/users/14886b6fbbce41c18c7aad9ab8b0e2eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:04.916455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.919620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.921058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.939494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:04.946374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:04.948425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.046218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:05.055289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eba7b7-4502-4be9-9923-0b0e0fa08a54 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.067712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1003/2007] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:05.068677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.069525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.069942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.070275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.071032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.072836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.089013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1005/2008] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:05.091485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.098141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.100531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.104324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518a26-1a0c-49f5-8506-dd0f74dcd198 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.110888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.111870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.112083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.112420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] PATH_INFO: `/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1/users/7d63018407954df28f60d51a24b2e966/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.114638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368ad516259a401ab6a7cf56e2e3d5f1, user_id=7d63018407954df28f60d51a24b2e966, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.131142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774757e-14da-47b2-9a86-a0296292e9c0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.154942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1004/2009] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:05 2022] PUT /identity/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1/users/7d63018407954df28f60d51a24b2e966/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:05.167172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.167960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.169387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.204363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] MFA Rules not processed for user `7d63018407954df28f60d51a24b2e966`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:05.206581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.211245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d732-27be-4340-9a34-680ecbdfcf57 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.280951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.281853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.282288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.282566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.314635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1005/2010] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:05.328247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.330140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.359638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.361301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.373078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1006/2011] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:05.426679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413727-fd57-470a-9cc8-449069cdf44e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.430425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.431049 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.431326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.431592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.441544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.442866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.453579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1006/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:05.595732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.597563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.611921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd175e3d-ffc4-456e-bda9-ee31bd5485f1 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.616293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.617301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.617862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.621597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.630830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.651812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:05.705191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.706840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.719327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1007/2013] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:05.817970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.822926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:05.848513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255ba98-0ce2-4626-b840-f9f1a2723f96 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:05.854451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:05.855338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:05.855984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:05.856364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] PATH_INFO: `/v3/projects/c6cfcc33cc734abe8ebc95b4e5201e0c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:05.858167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cfcc33cc734abe8ebc95b4e5201e0c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:05.861086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:05.920773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cfcc33cc734abe8ebc95b4e5201e0c', 'request_id': 'req-a14e799e-d64d-4b47-bde0-007ef07f703e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:05.927003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cfcc33cc734abe8ebc95b4e5201e0c', 'request_id': 'req-a14e799e-d64d-4b47-bde0-007ef07f703e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:05.938699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cfcc33cc734abe8ebc95b4e5201e0c', 'request_id': 'req-a14e799e-d64d-4b47-bde0-007ef07f703e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:05.941056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:05.957945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] The token cache is being invalidate because project c6cfcc33cc734abe8ebc95b4e5201e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:05.958481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:05.959506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:05.961504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1007/2014] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:05 2022] DELETE /identity/v3/projects/c6cfcc33cc734abe8ebc95b4e5201e0c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:05.971093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:05.985907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bc70-0ff5-4079-9029-fd88770f794a service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:06.053894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:06.054539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:06.054941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:06.055218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] PATH_INFO: `/v3/users/0b9f995e2b3d436d8b7df7b32eb8784d` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:06.056734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9f995e2b3d436d8b7df7b32eb8784d)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:06.058834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:06.141996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9f995e2b3d436d8b7df7b32eb8784d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.172600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9f995e2b3d436d8b7df7b32eb8784d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.181872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9f995e2b3d436d8b7df7b32eb8784d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.182953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9f995e2b3d436d8b7df7b32eb8784d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.184140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-49bcf93b-1cfb-4e77-9912-29e113e4db10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9f995e2b3d436d8b7df7b32eb8784d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.213228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1008/2015] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:05 2022] DELETE /identity/v3/users/0b9f995e2b3d436d8b7df7b32eb8784d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:06.646089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:06.647603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:06.667085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e799e-d64d-4b47-bde0-007ef07f703e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:06.798039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:06.799125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:06.799683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:06.800137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] PATH_INFO: `/v3/projects/861a633f30d0470a90f1361d08fff14e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:06.802990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] RBAC: Authorizing `identity:delete_project(project_id=861a633f30d0470a90f1361d08fff14e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:06.805555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:06.887341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861a633f30d0470a90f1361d08fff14e', 'request_id': 'req-9909958f-cb8c-4626-9612-672cd39f638d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.913192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861a633f30d0470a90f1361d08fff14e', 'request_id': 'req-9909958f-cb8c-4626-9612-672cd39f638d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.923507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861a633f30d0470a90f1361d08fff14e', 'request_id': 'req-9909958f-cb8c-4626-9612-672cd39f638d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.937226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] The token cache is being invalidate because project 861a633f30d0470a90f1361d08fff14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:06.937545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.938174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9909958f-cb8c-4626-9612-672cd39f638d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:06.940091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1008/2016] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:06 2022] DELETE /identity/v3/projects/861a633f30d0470a90f1361d08fff14e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:06.945154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:06.945657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:06.945657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:06.975798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:06.977042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:07.018636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:07.055956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1009/2017] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:07.064621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.064932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.065408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.087503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:07.088754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:07.097489 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1009/2018] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:07.102087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.113239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6f83e-97ed-48b7-b154-e3cbcbc86f09 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.118055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.118731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.119026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.119287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.119966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:07.120269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.121912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.133989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1010/2019] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:07.139440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.150351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d1bfd-8b9f-40dc-93c3-4c917723bc13 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.155847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.156464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.156951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.157115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.157738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.159780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.203157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1010/2020] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:07 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:07.204612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.218158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159f9a-20be-4fa3-b8d5-9db2fa4fa587 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.290771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.291329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.291593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.291862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.292563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.294614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.332233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1011/2021] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:07 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:07.336769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.349231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20aae8-0d23-4769-92ec-5ae749d124a5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.354696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.355167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.355651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.355933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.356720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.359201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.383428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1011/2022] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:07.386741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.398123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703e06a-196e-4559-bba3-d7dcd07ce28b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.403670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.404473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.404703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.405045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.405680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.407630 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b26ec-1714-43d1-8702-ee211808d40e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.438555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1012/2023] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:07.439940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.453207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476f5e-73a5-409f-86c8-124214fec4fa admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.458833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.459520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.459804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.460084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] PATH_INFO: `/v3/projects/04b48b5c96684a089e79697990c8c51e/users/9f85648dc6f049acb0c6912485298190/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.479084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b48b5c96684a089e79697990c8c51e, user_id=9f85648dc6f049acb0c6912485298190, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.481994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.504810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1012/2024] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:07 2022] PUT /identity/v3/projects/04b48b5c96684a089e79697990c8c51e/users/9f85648dc6f049acb0c6912485298190/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:07.510068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.510402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.510678 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.536175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:07.537446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:07.647414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1013/2025] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:07.658611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:07.662400 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:07.733927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:07.801823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab49-a64e-4ffc-a24e-6a4f71d17221 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:07.805857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:07.806909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:07.806909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:07.807188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:07.829110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:07.829110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:07.841604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1013/2026] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:08.021904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:08.024031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:08.044941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6245-9a2a-429c-94e5-2c09dbcfe928 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:08.059324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:08.060121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.060708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.061215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] PATH_INFO: `/v3/users/cb4a73af888d4efb955a3a89f745d86c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.062799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4a73af888d4efb955a3a89f745d86c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:08.065090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:08.108190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:08.108945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:08.133976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065fe78-9e8b-4352-87a5-b07d831c62e3 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:08.145980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:08.147021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.147021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.147216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] PATH_INFO: `/v3/users/cec9c6a3564a49efbc2894027e93db9d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.149749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec9c6a3564a49efbc2894027e93db9d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:08.160426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:08.190561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:08.213448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4a73af888d4efb955a3a89f745d86c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.258205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4a73af888d4efb955a3a89f745d86c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.265992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec9c6a3564a49efbc2894027e93db9d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.270497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4a73af888d4efb955a3a89f745d86c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.273527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4a73af888d4efb955a3a89f745d86c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.274995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b478f168-ed3f-4b18-a211-40f5d460a2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4a73af888d4efb955a3a89f745d86c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.280247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec9c6a3564a49efbc2894027e93db9d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.295721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec9c6a3564a49efbc2894027e93db9d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.296575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec9c6a3564a49efbc2894027e93db9d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.304917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1014/2027] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:08 2022] DELETE /identity/v3/users/cb4a73af888d4efb955a3a89f745d86c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:08.307317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.307656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.308077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.328100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-1ce3ba0a-59eb-4fd3-b143-4f1c361abbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec9c6a3564a49efbc2894027e93db9d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:08.343810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1014/2028] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:08 2022] DELETE /identity/v3/users/cec9c6a3564a49efbc2894027e93db9d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:08.348791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.349364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.349986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.350187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:08.351905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:08.441626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:08.445075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:08.488267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1015/2029] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:08.516088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:08.518224 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:08.636206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5f2d-e8c2-41eb-a5f9-6ae613bc43ea None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:08.649549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1015/2030] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:08.649671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:08.650442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.650442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.650797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.657120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:08.680589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a5b74-5dd0-487f-98b5-a24c93893f77 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:08.683123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:08.685930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:08.686795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:08.687479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:08.687759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:08.688084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:08.698310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:08.699834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:08.717483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1016/2031] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:08.756160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1016/2032] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:09.331471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:09.333265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:09.359636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66300d-f53a-4c41-9c4e-76cec4cd7d77 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:09.364503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875e55-e954-452f-907d-67751846f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:09.365928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875e55-e954-452f-907d-67751846f879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:09.366725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875e55-e954-452f-907d-67751846f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:09.367033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875e55-e954-452f-907d-67751846f879 admin admin] PATH_INFO: `/v3/projects/ef5b91303be84ebfa823ae1cf9f805bf` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:09.368954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875e55-e954-452f-907d-67751846f879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5b91303be84ebfa823ae1cf9f805bf)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:09.371103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875e55-e954-452f-907d-67751846f879 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:09.462395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5b91303be84ebfa823ae1cf9f805bf', 'request_id': 'req-11875e55-e954-452f-907d-67751846f879'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.475253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5b91303be84ebfa823ae1cf9f805bf', 'request_id': 'req-11875e55-e954-452f-907d-67751846f879'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.477036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:09.503134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5b91303be84ebfa823ae1cf9f805bf', 'request_id': 'req-11875e55-e954-452f-907d-67751846f879'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.543597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] The token cache is being invalidate because project ef5b91303be84ebfa823ae1cf9f805bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:09.543984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.544606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-11875e55-e954-452f-907d-67751846f879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.547286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1017/2033] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:09 2022] DELETE /identity/v3/projects/ef5b91303be84ebfa823ae1cf9f805bf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:09.551397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:09.565902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11168-333a-447b-8104-90cafeccece4 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:09.627598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:09.696575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:09.697312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:09.697744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:09.697954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] PATH_INFO: `/v3/users/d253ca9f85d0492492609383d4f8dc34` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:09.699258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d253ca9f85d0492492609383d4f8dc34)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:09.702732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:09.747282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:09.747604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:09.748191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:09.801464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] MFA Rules not processed for user `9f85648dc6f049acb0c6912485298190`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:09.803210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:09.827152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd253ca9f85d0492492609383d4f8dc34'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.846883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd253ca9f85d0492492609383d4f8dc34'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.857991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd253ca9f85d0492492609383d4f8dc34'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.859126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd253ca9f85d0492492609383d4f8dc34'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.876651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd253ca9f85d0492492609383d4f8dc34'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:09.886057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1017/2034] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:09 2022] DELETE /identity/v3/users/d253ca9f85d0492492609383d4f8dc34 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:09.929200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1018/2035] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:09.933582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:09.935936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:09.959666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:09.961493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:09.994238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514a184-5fc7-47e8-bbe1-ee3b8af0bbb9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.102921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d5c72-5811-426c-8655-891e9e1e3c5c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.117423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.118174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.118445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.118968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.120088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.123153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.133092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.133790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.134736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.135023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] PATH_INFO: `/v3/projects/2b9574f292a7422dbd78c74356a8a552` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.136925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9574f292a7422dbd78c74356a8a552)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.141847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.174467 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1018/2036] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:09 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:10.178542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.276550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:10.300440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9574f292a7422dbd78c74356a8a552', 'request_id': 'req-fbb3fc3e-27eb-4952-b103-665c98d9b327'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.316204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9574f292a7422dbd78c74356a8a552', 'request_id': 'req-fbb3fc3e-27eb-4952-b103-665c98d9b327'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.334319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9574f292a7422dbd78c74356a8a552', 'request_id': 'req-fbb3fc3e-27eb-4952-b103-665c98d9b327'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.353454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] The token cache is being invalidate because project 2b9574f292a7422dbd78c74356a8a552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:10.353757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.354460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-fbb3fc3e-27eb-4952-b103-665c98d9b327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.356126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b7f8-69d4-4440-a500-a0cb7d5f465c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.367732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1019/2037] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:09 2022] DELETE /identity/v3/projects/2b9574f292a7422dbd78c74356a8a552 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:10.367867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4355c3-3b84-4517-927f-c3e401bbf616 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.368175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4355c3-3b84-4517-927f-c3e401bbf616 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.368332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4355c3-3b84-4517-927f-c3e401bbf616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.380931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:10.404425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5f4355c3-3b84-4517-927f-c3e401bbf616 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:10.405736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5f4355c3-3b84-4517-927f-c3e401bbf616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.472293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.474508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.475685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.476707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.478681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.480684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.520215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1020/2038] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:10.522116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.522657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.523107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.542336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1019/2039] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:10 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:10.543540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.546420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.553633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:10.558324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.577494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a24-fbba-4a40-9274-dba5782ff92f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.582306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1021/2040] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:10.583798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.592649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.594558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.594860 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.595180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.597961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.607257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.618636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b24d11-642d-4ff0-a2cc-ed6004b0fc7b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.623775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.624470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.625104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.625391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.626304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:10.626433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.631241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1020/2041] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:10.631767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.632209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.636401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.653229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1022/2042] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:50:10.655773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.657085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c192a8-5d89-424b-818b-4833d3cb583e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.664905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.665632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.666052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.666331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] PATH_INFO: `/v3/projects/c68272d3252940129cb720505a228160` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.667819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68272d3252940129cb720505a228160)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.670022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.670452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64acd5-04f3-4028-a3bd-96b82ec63d01 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.680006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.680875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.681195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.681476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] PATH_INFO: `/v3/projects/f9395a856ada406ab1a9e9699b88b08d/users/4ad792a37a364e429dc9303f0fa28869/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.705075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9395a856ada406ab1a9e9699b88b08d, user_id=4ad792a37a364e429dc9303f0fa28869, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.708874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.728720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1023/2043] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:10 2022] PUT /identity/v3/projects/f9395a856ada406ab1a9e9699b88b08d/users/4ad792a37a364e429dc9303f0fa28869/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:10.730012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.760504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68272d3252940129cb720505a228160', 'request_id': 'req-9847d00e-4613-4d22-ba0b-91270bff0d4b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.774579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68272d3252940129cb720505a228160', 'request_id': 'req-9847d00e-4613-4d22-ba0b-91270bff0d4b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.790436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68272d3252940129cb720505a228160', 'request_id': 'req-9847d00e-4613-4d22-ba0b-91270bff0d4b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.822320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] The token cache is being invalidate because project c68272d3252940129cb720505a228160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:10.822935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.826608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:10.832469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1021/2044] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:10 2022] DELETE /identity/v3/projects/c68272d3252940129cb720505a228160 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:10.833794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:10.837511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.914498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd7c03-bbe2-42e2-ab8b-4d924231003c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.923732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:10.957795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d00e-4613-4d22-ba0b-91270bff0d4b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:10.963150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:10.963834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.964108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.964408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:10.965262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:10.966828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99688fe4-d686-42ed-9bbf-9cca462023ea admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:10.979617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1022/2045] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:10.981230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650782-2114-4655-af23-c26b8817d189 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:10.981576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650782-2114-4655-af23-c26b8817d189 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:10.981862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650782-2114-4655-af23-c26b8817d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.001321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.001956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.002231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.002622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.003290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.005341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eca79-a3cb-402f-ba56-d9735832e067 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.009700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-32650782-2114-4655-af23-c26b8817d189 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:11.011259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-32650782-2114-4655-af23-c26b8817d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.017843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:11.025736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1023/2046] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:11.026597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650782-2114-4655-af23-c26b8817d189 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.044592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650782-2114-4655-af23-c26b8817d189 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.049980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1024/2047] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:11.051861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.052287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.052689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.053266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.054063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.054356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.054631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] PATH_INFO: `/v3/projects/f9395a856ada406ab1a9e9699b88b08d/users/4ad792a37a364e429dc9303f0fa28869/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.057280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9395a856ada406ab1a9e9699b88b08d, user_id=4ad792a37a364e429dc9303f0fa28869, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.060273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.076741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1024/2048] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:11 2022] PUT /identity/v3/projects/f9395a856ada406ab1a9e9699b88b08d/users/4ad792a37a364e429dc9303f0fa28869/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:11.077192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.084557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.086446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:11.088039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.171754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1025/2049] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:11.173315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.173461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f629a-d969-4191-8fd6-7c2d8cfa1644 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.175478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.181483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.182376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.183002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.184278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.186508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.189530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.189996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b5b27-89b0-47d5-b5cb-d53695ba11a2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.195250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.195983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.196283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.196722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] PATH_INFO: `/v3/users/a7f6fee35c0c498eb52e7491f63936cb` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.197819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f6fee35c0c498eb52e7491f63936cb)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.200436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.217199 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1025/2050] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:11.218551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.230653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14aa3-dad7-4416-bce8-c76c640817c8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.237450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.238208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.238678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.239060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.239835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:11.240208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.242195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.256197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1026/2051] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:11.257225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.268532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f6fee35c0c498eb52e7491f63936cb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:11.268923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38052e-eb9b-49e4-a33d-01154f571659 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.275535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.276340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.276737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.277143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.277925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.280150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.285520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f6fee35c0c498eb52e7491f63936cb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:11.295688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1027/2052] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:11.297393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.300817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f6fee35c0c498eb52e7491f63936cb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:11.301900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f6fee35c0c498eb52e7491f63936cb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:11.302749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f6fee35c0c498eb52e7491f63936cb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:11.310542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcaab1-8e53-49e9-9c43-5df1ea7bef7d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.323379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.324255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.324533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.324800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.327069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.329176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1026/2053] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:11 2022] DELETE /identity/v3/users/a7f6fee35c0c498eb52e7491f63936cb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:11.332925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.333458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.335133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0988c5-5e91-4256-89b2-e3d3b64c90b3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.406614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1028/2054] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:11.406614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.406614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.406614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.430767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:11.432152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.446952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576f3e-996f-4ec3-a6db-413cdba5d1b6 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.457687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:11.523317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:11.537155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1029/2055] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:11.539116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.542484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.563458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e5d0-f765-4892-ab71-b592a045ba21 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.563994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.564682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.564995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.565265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.566123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.567980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.571219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.571930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.572254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.572530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.573253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.575607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.580616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1027/2056] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:11.582567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.585174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.605431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1030/2057] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/users => generated 304 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:11.607175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.622535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd175b0-46e8-4bb5-826c-46910699b494 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.627766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.628526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.628992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.629240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] PATH_INFO: `/v3/projects/cdd24cb59b6f418791aed7f2d2d02720/users/d762f36a3fa44c77a1e524aeb0218027/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.657207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd24cb59b6f418791aed7f2d2d02720, user_id=d762f36a3fa44c77a1e524aeb0218027, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.660364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.664350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282037-d5f3-404f-967f-50ce22bfed92 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.670542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.671752 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.672056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.672384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.682025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1031/2058] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:11 2022] PUT /identity/v3/projects/cdd24cb59b6f418791aed7f2d2d02720/users/d762f36a3fa44c77a1e524aeb0218027/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:11.683661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.687584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.689580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b907156-6f59-4f78-a301-8e540c9c4b85 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.707166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1028/2059] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:11.717149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.717434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.717707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.780154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b24e-6489-4252-ac5d-665ff3164808 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.784829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] MFA Rules not processed for user `d762f36a3fa44c77a1e524aeb0218027`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:11.786870 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:11.786999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.787112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.787376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.787647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.788572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.790417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.809980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1032/2060] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:11.811810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.824414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b8df-2b9d-4a2a-a771-d56a48f0ac9f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.830145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.831026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.831625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.831995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.832810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.834799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.868852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1033/2061] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:11.870534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:11.895714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ef83-6351-43af-ad94-37cc569a8692 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:11.911027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:11.911899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:11.912345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:11.912724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] PATH_INFO: `/v3/projects/2d92c041adde460cae62bb534b60b71c/users/0958ae17f7814e0eaa7e03ca7a9521d4/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:11.961408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1029/2062] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:11.981755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d92c041adde460cae62bb534b60b71c, user_id=0958ae17f7814e0eaa7e03ca7a9521d4, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:11.984285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf062c-1aee-4748-8317-0989108a257f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:11.999094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:12.000819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:12.019250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1034/2063] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:11 2022] PUT /identity/v3/projects/2d92c041adde460cae62bb534b60b71c/users/0958ae17f7814e0eaa7e03ca7a9521d4/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:12.035557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.035903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.036221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.121768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] MFA Rules not processed for user `0958ae17f7814e0eaa7e03ca7a9521d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:12.124933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:12.127993 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:12.152990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d1df-944a-4685-93a1-7b3de5fda224 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:12.285703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:12.286438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.286784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.287124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.319986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1035/2064] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:12.324320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:12.342630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:12.416023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:12.419036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:12.439876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1030/2065] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:12.441320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:12.443900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:12.503979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160925c2-42a2-4256-b408-8162f03fa2ac None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:12.523342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:12.524079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.524418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.524902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.530974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:12.534593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:12.558102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4fa2-1f67-462b-a44f-e101bf567fde service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:12.575567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:12.576580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.576934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.577250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] PATH_INFO: `/v3/projects/39735de851e7453795888aa56abf63e1` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.579548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39735de851e7453795888aa56abf63e1)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:12.586011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:12.606031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1036/2066] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:12 2022] POST /identity/v3/projects => generated 407 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:12.610788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:12.701047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39735de851e7453795888aa56abf63e1', 'request_id': 'req-da335687-f31d-4bf1-9633-c90314f6e24a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:12.705553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:12.718864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39735de851e7453795888aa56abf63e1', 'request_id': 'req-da335687-f31d-4bf1-9633-c90314f6e24a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:12.734499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39735de851e7453795888aa56abf63e1', 'request_id': 'req-da335687-f31d-4bf1-9633-c90314f6e24a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:12.751734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744103b-6148-4900-bf72-cf2c76843a2d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:12.782578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] The token cache is being invalidate because project 39735de851e7453795888aa56abf63e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:12.782880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:12.789458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:12.799121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1031/2067] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:12 2022] DELETE /identity/v3/projects/39735de851e7453795888aa56abf63e1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:12.800150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:12.810564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:12.882754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:12.885737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.886028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.886297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.889907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:12.896749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1a8c9-62b1-4f77-b0a4-ed11205ae533 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:12.935827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1037/2068] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:12 2022] POST /identity/v3/users => generated 310 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:12.937243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:12.937568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:12.937845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:12.991147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] MFA Rules not processed for user `4ad792a37a364e429dc9303f0fa28869`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:12.992158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.007345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335687-f31d-4bf1-9633-c90314f6e24a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.023271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.023813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.024151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.024429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] PATH_INFO: `/v3/users/ff5c4d06ea4d45cba44517abc7eb8c24` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.025577 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:13.025930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5c4d06ea4d45cba44517abc7eb8c24)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.027980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.157805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1038/2069] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:13.158686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.160210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.165898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5c4d06ea4d45cba44517abc7eb8c24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.179560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e2f8-7961-4395-8db0-48198394066f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.182655 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5c4d06ea4d45cba44517abc7eb8c24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.185651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.186690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.187023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.187327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.188069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.190004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3be4-18c5-4941-876c-1b58c62f9609 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.191627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5c4d06ea4d45cba44517abc7eb8c24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.192532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5c4d06ea4d45cba44517abc7eb8c24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.193278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5c4d06ea4d45cba44517abc7eb8c24'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.206097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1039/2070] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:13.207788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.208235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.208712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.219681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1032/2071] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:12 2022] DELETE /identity/v3/users/ff5c4d06ea4d45cba44517abc7eb8c24 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:13.223487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.225382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.233886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] MFA Rules not processed for user `9f85648dc6f049acb0c6912485298190`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:13.235827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.314859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1040/2072] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:13.335171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.337140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.338182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31173-ed62-4b9b-91df-b3f18172728a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.343546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.344329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.344682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.345159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] PATH_INFO: `/v3/projects/3d9dc816cdd94053b40aafa655bc306d/users/49d60a886f9e4d2e91b6e55005af216d/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.347580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:13.364490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9dc816cdd94053b40aafa655bc306d, user_id=49d60a886f9e4d2e91b6e55005af216d, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.368539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.391405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1033/2073] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:13 2022] PUT /identity/v3/projects/3d9dc816cdd94053b40aafa655bc306d/users/49d60a886f9e4d2e91b6e55005af216d/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:13.395391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.427762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b692-da64-42ca-880e-c5de29860014 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.490480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b33fd-071a-4ab2-98e5-6d6888b09c7e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.495126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:13.498938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.499922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.500421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.501186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.502408 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.504403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.516062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1034/2074] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:13.520228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.523305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.523926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.524206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.524479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.526503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.535650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576f484-fa3a-4bb2-b725-4cbc95f62866 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.541451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.542252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.542647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.542981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] PATH_INFO: `/v3/projects/3d9dc816cdd94053b40aafa655bc306d/users/49d60a886f9e4d2e91b6e55005af216d/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.545083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9dc816cdd94053b40aafa655bc306d, user_id=49d60a886f9e4d2e91b6e55005af216d, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.547896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288d752-d5a7-444d-8864-8ae313d7e3ed admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.561195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1035/2075] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:13 2022] PUT /identity/v3/projects/3d9dc816cdd94053b40aafa655bc306d/users/49d60a886f9e4d2e91b6e55005af216d/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:13.571496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.571976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.572354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.604456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.606123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.607270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] MFA Rules not processed for user `49d60a886f9e4d2e91b6e55005af216d`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:13.608703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.616995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1041/2076] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:13.657422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.659599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.682651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dda51e-a468-4d53-9d11-a8a444664c10 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.707562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1036/2077] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:13.722132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:13.724040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.758142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.759014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.759335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.759703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] PATH_INFO: `/v3/projects/aed542183e634ef9bdc8c9492b4bc2da` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.761001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed542183e634ef9bdc8c9492b4bc2da)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.763163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.809939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa9b75-324a-4668-9515-8db4bc8581b6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:13.813887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:13.825256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed542183e634ef9bdc8c9492b4bc2da', 'request_id': 'req-79f26a92-5595-4fac-a356-136f856be1f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.835374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed542183e634ef9bdc8c9492b4bc2da', 'request_id': 'req-79f26a92-5595-4fac-a356-136f856be1f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.847646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed542183e634ef9bdc8c9492b4bc2da', 'request_id': 'req-79f26a92-5595-4fac-a356-136f856be1f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.859610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] The token cache is being invalidate because project aed542183e634ef9bdc8c9492b4bc2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:13.859909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.860612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79f26a92-5595-4fac-a356-136f856be1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:13.862332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1042/2078] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:13 2022] DELETE /identity/v3/projects/aed542183e634ef9bdc8c9492b4bc2da => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:13.867194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.867544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.867880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.874189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:13.874962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.875307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.875644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:13.877536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.891291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:13.893161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:13.907135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:13.944200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:13.945644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46070-dc3c-4e55-a3e8-80b5a28938d8 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:13.956152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1037/2079] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:13 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:13.969883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1043/2080] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:13.978256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:13.978723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:13.979254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.002858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:14.004121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:14.012565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1038/2081] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:14.017030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.028689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0255-61ed-490b-bf68-2caf35194680 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.035057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.035857 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.036125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.036396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.037093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:14.037389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.039192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.056845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1044/2082] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:14.058076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.068398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a179ab-3a75-49f5-ba1f-36a16c0576b3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.078751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.078751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.078751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.078751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.079256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.079256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.116469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1039/2083] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:14.121089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.135543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cc6c-ee81-4295-bb8a-0657db76c696 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.218226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.219339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.219625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.219898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.225101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.228213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.263432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.265580 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:14.271533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1045/2084] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:14.275858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.288053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4995d2-ca48-4f1c-bc8a-ff321bcd7706 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.293768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.294734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.295135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.295562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.296345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.298564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.315065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1046/2085] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:14.319442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.331911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d418-6e1d-4ede-a4fa-f70b54ac3aca admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.338544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.339436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.339969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.340472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.341346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.343364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.355389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1047/2086] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:14.360358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.383774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c071fc-5c3e-433f-8555-505ce42b431e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.384521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9dcdd7-4d82-42a7-80c2-e90ce76e9fdd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.393724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.395329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.395613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.395884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.396297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.397170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.397660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.397961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:14.400244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] PATH_INFO: `/v3/projects/2143824c167a4f7283a60c54e8f80aef/users/b27843013adb4066bbea908c4fb7f2b7/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.425725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2143824c167a4f7283a60c54e8f80aef, user_id=b27843013adb4066bbea908c4fb7f2b7, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.428461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f237fa-3860-41c8-b31d-11514ff667ed admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.451771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1048/2087] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:14 2022] PUT /identity/v3/projects/2143824c167a4f7283a60c54e8f80aef/users/b27843013adb4066bbea908c4fb7f2b7/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:14.464267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.464553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.464822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.504916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] MFA Rules not processed for user `b27843013adb4066bbea908c4fb7f2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:14.507183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:14.536350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:14.594050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.595677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.608232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1040/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:14 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:14.617487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:14.665714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1049/2089] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:14.668239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.680466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936489-5442-4c81-aee7-e66500554f77 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.789489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.790137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.790388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.790659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.791296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.793250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.847481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1041/2090] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:14.852694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:14.869714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd095a63-4724-4a32-a243-9aef98aa6734 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:14.954410 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:14.955455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.955741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.956012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.957794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:14.960281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:14.994792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1050/2091] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:14.999257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.010144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe562-5f94-4967-8d0c-08e9784112dc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.021750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.022390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.022668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.022977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.023595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.025364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.049114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1042/2092] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:15.053193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.080068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a406cd-c8b5-4465-ad42-1714eb39c9e6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.088981 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.089778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.090111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.090427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] PATH_INFO: `/v3/projects/b6cb0e3c70374c909045bdf89353553f/users/9eb3ba092488469cbc2d627c9681986a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.108264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cb0e3c70374c909045bdf89353553f, user_id=9eb3ba092488469cbc2d627c9681986a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.111387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.151313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1051/2093] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:15 2022] PUT /identity/v3/projects/b6cb0e3c70374c909045bdf89353553f/users/9eb3ba092488469cbc2d627c9681986a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:15.159998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.172673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818def6e-85cc-4ae8-b858-b9205388e72d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.280114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.280747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.281047 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.281469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.282118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.283788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ebe3-5d1a-4075-a661-716acf500b53 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.295863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1043/2094] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:15.300161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.310984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2c038-aa7f-4543-a3e5-62a8238d3213 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.317740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.318409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.318685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.318954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] PATH_INFO: `/v3/projects/b6cb0e3c70374c909045bdf89353553f/users/9eb3ba092488469cbc2d627c9681986a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.323109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cb0e3c70374c909045bdf89353553f, user_id=9eb3ba092488469cbc2d627c9681986a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.325926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.341973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1052/2095] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:15 2022] PUT /identity/v3/projects/b6cb0e3c70374c909045bdf89353553f/users/9eb3ba092488469cbc2d627c9681986a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:15.357753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.358099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.358373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.397180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] MFA Rules not processed for user `9eb3ba092488469cbc2d627c9681986a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:15.398609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:15.449958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:15.484082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1044/2096] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:15.495925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.497967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:15.577426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad14c3-f664-470b-afc5-84d138162901 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.583177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.583814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.584155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.584482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.616161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.622066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.646508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1053/2097] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:15.738439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:15.757612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dba76-144d-4c69-9d2b-63663f9fdf91 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:15.762234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:15.763032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.763571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.764045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.835356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:15.837948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2b53-c023-432b-a96e-718410914805 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:15.849002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1045/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:19.194001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:19.224827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:19.259589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bcb-4deb-47d6-ba88-df356cf54314 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:19.265144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:19.265792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.266101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.266373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] PATH_INFO: `/v3/users/b27843013adb4066bbea908c4fb7f2b7` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.267511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27843013adb4066bbea908c4fb7f2b7)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:19.269523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:19.319056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27843013adb4066bbea908c4fb7f2b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:19.327966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27843013adb4066bbea908c4fb7f2b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:19.336268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27843013adb4066bbea908c4fb7f2b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:19.336933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27843013adb4066bbea908c4fb7f2b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:19.349583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27843013adb4066bbea908c4fb7f2b7'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:19.356082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1054/2099] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:19 2022] DELETE /identity/v3/users/b27843013adb4066bbea908c4fb7f2b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:19.360825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.361324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.361436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.380837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:19.382074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:19.453107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1046/2100] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:19.462635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:19.464168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:19.546740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c158-9206-497a-91b2-c38da8ac55b0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:19.551953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:19.552648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.552929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.553226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.563447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:19.564987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:19.575302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1055/2101] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:20.332846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:20.335172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:20.356808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ea6fc-0fd2-4941-8cb6-01ac71ad46c6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:20.370422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:20.373919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:20.374482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:20.374953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] PATH_INFO: `/v3/projects/2143824c167a4f7283a60c54e8f80aef` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:20.377896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2143824c167a4f7283a60c54e8f80aef)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:20.383704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:20.514608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2143824c167a4f7283a60c54e8f80aef', 'request_id': 'req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.524159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2143824c167a4f7283a60c54e8f80aef', 'request_id': 'req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.532292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2143824c167a4f7283a60c54e8f80aef', 'request_id': 'req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.552459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:20.563453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] The token cache is being invalidate because project 2143824c167a4f7283a60c54e8f80aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:20.564024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.568245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.573592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1047/2102] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:20 2022] DELETE /identity/v3/projects/2143824c167a4f7283a60c54e8f80aef => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:20.577932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:20.591502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455c5-e627-4e21-ab8e-74fdbd218467 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:20.651873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:20.667896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:20.668695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:20.670266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:20.671161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] PATH_INFO: `/v3/users/9eb3ba092488469cbc2d627c9681986a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:20.673240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb3ba092488469cbc2d627c9681986a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:20.683743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:20.777397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb3ba092488469cbc2d627c9681986a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.791872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb3ba092488469cbc2d627c9681986a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.811304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb3ba092488469cbc2d627c9681986a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.813660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb3ba092488469cbc2d627c9681986a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.846825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d8130545-155a-406f-a7f6-d9d5e2345e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb3ba092488469cbc2d627c9681986a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:20.859075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1056/2103] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:20 2022] DELETE /identity/v3/users/9eb3ba092488469cbc2d627c9681986a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:20.950440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:20.952245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:20.970934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a26c-0bee-494b-9a4c-dfe2f8f47115 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:21.074269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:21.076027 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:21.076257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:21.076536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] PATH_INFO: `/v3/users/0958ae17f7814e0eaa7e03ca7a9521d4` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:21.078657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958ae17f7814e0eaa7e03ca7a9521d4)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:21.081195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:21.173663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958ae17f7814e0eaa7e03ca7a9521d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.207355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958ae17f7814e0eaa7e03ca7a9521d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.225553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958ae17f7814e0eaa7e03ca7a9521d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.226794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958ae17f7814e0eaa7e03ca7a9521d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.227603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958ae17f7814e0eaa7e03ca7a9521d4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.255456 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1048/2104] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:20 2022] DELETE /identity/v3/users/0958ae17f7814e0eaa7e03ca7a9521d4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:21.257685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:21.257984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:21.258270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:21.281128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:21.282610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:21.394350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1057/2105] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:21.407425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:21.409867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:21.527263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ee85f-2df4-4452-817b-5901a87dc2a4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:21.532021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:21.532914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:21.533435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:21.533921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:21.547434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:21.549763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f55a1-7214-4cf9-bf65-8bf7115528fd service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:21.569299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1049/2106] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:21.649204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:21.651667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:21.668508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd277e-9afe-40b8-9b6f-29c70b0dd6f1 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:21.676138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:21.677698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:21.679293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:21.679743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] PATH_INFO: `/v3/projects/b6cb0e3c70374c909045bdf89353553f` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:21.681740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cb0e3c70374c909045bdf89353553f)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:21.684557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:21.820671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cb0e3c70374c909045bdf89353553f', 'request_id': 'req-2e9359d5-1526-406c-9610-568499637fb0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.828215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cb0e3c70374c909045bdf89353553f', 'request_id': 'req-2e9359d5-1526-406c-9610-568499637fb0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.846352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cb0e3c70374c909045bdf89353553f', 'request_id': 'req-2e9359d5-1526-406c-9610-568499637fb0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.848087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:21.881178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] The token cache is being invalidate because project b6cb0e3c70374c909045bdf89353553f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:21.881729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.882778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2e9359d5-1526-406c-9610-568499637fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:21.884636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1058/2107] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:21 2022] DELETE /identity/v3/projects/b6cb0e3c70374c909045bdf89353553f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:21.889513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:21.889920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:21.890297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:21.916845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:21.919469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:21.943435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:22.009368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1050/2108] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:22.018535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.018850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.019129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.045338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:22.046622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.059732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1059/2109] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:22.061488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.061864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.063028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.080951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2dc87-baac-484b-8d6b-62b602236c6c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.083746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3f9a-b433-48dd-a29a-2e2afdc4b3c3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.088769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.089550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.090938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.090938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.091660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:22.092177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.092600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.093294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.093570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.093883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] PATH_INFO: `/v3/projects/2d92c041adde460cae62bb534b60b71c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.094261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.095111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d92c041adde460cae62bb534b60b71c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.097305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.123477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1060/2110] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:22.128262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.143562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474f1d-5514-4a83-9329-91212ff5f33a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.149107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.149734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.150021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.150293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.153725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.155662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.185166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d92c041adde460cae62bb534b60b71c', 'request_id': 'req-366a93f9-8a97-4188-a4c2-a3f001efa50a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.195755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1061/2111] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:22.201345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.202006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d92c041adde460cae62bb534b60b71c', 'request_id': 'req-366a93f9-8a97-4188-a4c2-a3f001efa50a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.211016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d92c041adde460cae62bb534b60b71c', 'request_id': 'req-366a93f9-8a97-4188-a4c2-a3f001efa50a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.249576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] The token cache is being invalidate because project 2d92c041adde460cae62bb534b60b71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:22.249874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.250627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.252291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1051/2112] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:22 2022] DELETE /identity/v3/projects/2d92c041adde460cae62bb534b60b71c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:22.253123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.255885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.289332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f5421-acc0-4530-9b27-18d970af9061 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.294701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.295382 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.295669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.295943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.296616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.298597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.325929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1062/2113] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:22.325929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.325929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.339011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a93f9-8a97-4188-a4c2-a3f001efa50a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.339247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd369-3084-4633-96fa-1886fa60a3cd admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.344108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.344747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.345070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.345347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] PATH_INFO: `/v3/users/49d60a886f9e4d2e91b6e55005af216d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.346384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.346514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d60a886f9e4d2e91b6e55005af216d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.347230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.347742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.348108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] PATH_INFO: `/v3/users/3c024c6d248d47b88c0fa00d581621c8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.348386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.349521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c024c6d248d47b88c0fa00d581621c8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.353053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.406069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d60a886f9e4d2e91b6e55005af216d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.417939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d60a886f9e4d2e91b6e55005af216d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.422092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c024c6d248d47b88c0fa00d581621c8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.423434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:22.430959 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d60a886f9e4d2e91b6e55005af216d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.432072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d60a886f9e4d2e91b6e55005af216d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.440435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c024c6d248d47b88c0fa00d581621c8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.446787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d60a886f9e4d2e91b6e55005af216d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.448792 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c024c6d248d47b88c0fa00d581621c8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.450446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c024c6d248d47b88c0fa00d581621c8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.451409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-15929c92-af3d-4184-be53-3bdc57b38cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c024c6d248d47b88c0fa00d581621c8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:22.453923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1063/2114] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:22 2022] DELETE /identity/v3/users/49d60a886f9e4d2e91b6e55005af216d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:22.455001 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.456268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.471668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:22.488608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1052/2115] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:22 2022] DELETE /identity/v3/users/3c024c6d248d47b88c0fa00d581621c8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:22.495127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.495412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.495695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.525362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:22.526195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.552549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba8d2-a3cc-4809-9cf6-d83a5613fbf5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.643015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1053/2116] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:22.689113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.689716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.690063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.690435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.691494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.693415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.695868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.697410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.724480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1064/2117] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:22.728499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.733994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.760728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f23a2-2329-4254-9567-d664c7ed3832 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.777801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.779215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.779648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.780597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.782122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.784645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.798576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1065/2118] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:22.805855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.822136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b2dc-911d-4f59-8876-9fa6c3fff4c9 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.826506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432bba2-999c-4b3a-bb49-5c635651e0fe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:22.829089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.830124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.830466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.830749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] PATH_INFO: `/v3/projects/1f3ea2b578ee448abf846909895ff112/users/00786ea0d3c3433691453d29ce20c3d8/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.831155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:22.831940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.832374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.832785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.845781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.847533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530df7a-9453-488a-85e4-7c41cd34e818 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.859229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3ea2b578ee448abf846909895ff112, user_id=00786ea0d3c3433691453d29ce20c3d8, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:22.864587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:22.873261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1054/2119] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:22.893997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1066/2120] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:22 2022] PUT /identity/v3/projects/1f3ea2b578ee448abf846909895ff112/users/00786ea0d3c3433691453d29ce20c3d8/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:22.908364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.908652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.909074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.962220 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] MFA Rules not processed for user `00786ea0d3c3433691453d29ce20c3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:22.963957 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:22.965914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.972937 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.072297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d54dba-2401-4898-a636-00c6d4b80837 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.077769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.078578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.085449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.085748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] PATH_INFO: `/v3/projects/3d9dc816cdd94053b40aafa655bc306d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.087061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9dc816cdd94053b40aafa655bc306d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.089618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.114441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:23.118035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:23.127139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1055/2121] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:23.146066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.163482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9dc816cdd94053b40aafa655bc306d', 'request_id': 'req-f8242adf-9632-4534-8b77-198eba009973'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:23.171929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41453992-fd24-48b4-b139-dce5b4fa10cf None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.187635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9dc816cdd94053b40aafa655bc306d', 'request_id': 'req-f8242adf-9632-4534-8b77-198eba009973'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:23.210490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9dc816cdd94053b40aafa655bc306d', 'request_id': 'req-f8242adf-9632-4534-8b77-198eba009973'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:23.229641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] The token cache is being invalidate because project 3d9dc816cdd94053b40aafa655bc306d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:23.229919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:23.235791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f8242adf-9632-4534-8b77-198eba009973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:23.240075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1067/2122] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:22 2022] DELETE /identity/v3/projects/3d9dc816cdd94053b40aafa655bc306d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:23.247016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb1cd-3525-41d6-b2c1-926214ea6c5b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.247648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb1cd-3525-41d6-b2c1-926214ea6c5b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.248336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb1cd-3525-41d6-b2c1-926214ea6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.294031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ec6bb1cd-3525-41d6-b2c1-926214ea6c5b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:23.296162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ec6bb1cd-3525-41d6-b2c1-926214ea6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.315148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.315730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.316011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.316281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.316940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.318940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.388398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1056/2123] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/projects => generated 399 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:23.390904 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.393566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.418196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1068/2124] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:23.427373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.427678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.427953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.464935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:23.470044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.539561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b16bb-46ee-4389-879c-0e1557bdf061 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.545613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.546379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.546758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.547484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.548170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.550301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.588209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1057/2125] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/users => generated 306 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:23.593769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1069/2126] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:23.594210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.597058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.611348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf2f8-a4e3-4a04-8fdd-4c60e345c66d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.614985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b6d74-fe7d-4719-93c9-c78cb6bc59ee None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.616995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.617521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.617895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.618499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.619579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.621597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.637078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1058/2127] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:23.637520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.638164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.638442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.638879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.639549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:23.639850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.641702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.641856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.653311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376c57-5263-4d29-9381-4835744f507f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.661024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1070/2128] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:50:23.661217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.661217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.661217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.661217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] PATH_INFO: `/v3/projects/8a96f082d0664b74a6cb591763173450/users/0bd99526150d470298639589cb30cd90/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.663536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.679934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a96f082d0664b74a6cb591763173450, user_id=0bd99526150d470298639589cb30cd90, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.683173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.683950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874f4d6-67e9-4632-b268-23d2578a1e83 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.690570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.691522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.692888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.693545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.694512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.697964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.711653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1059/2129] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:23 2022] PUT /identity/v3/projects/8a96f082d0664b74a6cb591763173450/users/0bd99526150d470298639589cb30cd90/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:23.714847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.718062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.779041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1071/2130] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:23.780017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.805898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:23.812503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:23.836813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e866f-3095-4092-9813-566b67c9e680 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.861259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455516-99fc-4dae-9634-2dc7d7b378b5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.866379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.867063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.867346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.867617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.868470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.870144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.884910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1072/2131] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:23.886047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.897805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f011d9-5959-429c-af91-99da8fc4608c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.905757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.906866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.907303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.907729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.908518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.911493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.931312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.932080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.932501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.933139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] PATH_INFO: `/v3/projects/0d6c4d9fba3e4faa817d67f31e707ab8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.934778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6c4d9fba3e4faa817d67f31e707ab8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.937195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.942155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1073/2132] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:23 2022] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:23.943252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.956854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140534-4040-42a6-b5a3-8a837455ce80 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.963398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.964440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.964872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.965351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] PATH_INFO: `/v3/projects/8a96f082d0664b74a6cb591763173450/users/0bd99526150d470298639589cb30cd90/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.968767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a96f082d0664b74a6cb591763173450, user_id=0bd99526150d470298639589cb30cd90, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.972050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.990064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1074/2133] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:23 2022] PUT /identity/v3/projects/8a96f082d0664b74a6cb591763173450/users/0bd99526150d470298639589cb30cd90/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:23.991451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.019122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6c4d9fba3e4faa817d67f31e707ab8', 'request_id': 'req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.041854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6c4d9fba3e4faa817d67f31e707ab8', 'request_id': 'req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.054896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6c4d9fba3e4faa817d67f31e707ab8', 'request_id': 'req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.080961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] The token cache is being invalidate because project 0d6c4d9fba3e4faa817d67f31e707ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:24.083463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.086196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e90b63c4-3a83-4184-a2b2-42f9914ef5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.087700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177050b-601a-4616-b386-aaed6a93f3a6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.090682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1060/2134] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:23 2022] DELETE /identity/v3/projects/0d6c4d9fba3e4faa817d67f31e707ab8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:24.092828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.093912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.094557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.135152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] MFA Rules not processed for user `0bd99526150d470298639589cb30cd90`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:24.137533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.185099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.186393 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.186850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.187292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.188155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.190258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.211092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1075/2135] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:24.212567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.215792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.237739 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269481d8-826e-43e2-9082-841781d3b39e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.244397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.245490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.245842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.246898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] PATH_INFO: `/v3/users/7d63018407954df28f60d51a24b2e966` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.250026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d63018407954df28f60d51a24b2e966)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.250657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.253401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:24.262011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1061/2136] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:24.262011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.263922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.291808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f433-ea69-44ba-ad3c-1b0efd0e39e8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.292785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:24.301607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.302452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.302805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.303202 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.304004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.305996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.325853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1062/2137] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:24.326932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.330450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.336174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d63018407954df28f60d51a24b2e966'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.345260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d63018407954df28f60d51a24b2e966'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.352688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d63018407954df28f60d51a24b2e966'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.353375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d63018407954df28f60d51a24b2e966'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.366835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d63018407954df28f60d51a24b2e966'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:24.375590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1076/2138] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:24 2022] DELETE /identity/v3/users/7d63018407954df28f60d51a24b2e966 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:24.376663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.377869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.397654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2883-251e-4b14-8a18-b6bed3f0cbe1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.484920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.485771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.487061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.487768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.490086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.533476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b57fa-593f-4655-97c9-73356abe4294 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.540864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.542417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.543103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.543540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] PATH_INFO: `/v3/projects/50cd8ecffa1c4fa0bebd78fbf7c2cfd7/users/8cb98bf6dad24fcda302a9f921b6db4f/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.569034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cd8ecffa1c4fa0bebd78fbf7c2cfd7, user_id=8cb98bf6dad24fcda302a9f921b6db4f, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.571874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.573873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.576559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faeb0d-e3f6-4ae9-8952-e73ddefd073b service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.587595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1063/2139] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:24.595236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1077/2140] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:24 2022] PUT /identity/v3/projects/50cd8ecffa1c4fa0bebd78fbf7c2cfd7/users/8cb98bf6dad24fcda302a9f921b6db4f/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:24.602005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.602342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.602616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.648453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] MFA Rules not processed for user `8cb98bf6dad24fcda302a9f921b6db4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:24.649726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.716929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:24.718911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.721362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.770913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1064/2141] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:24.786632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.788198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.806339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8b34-b9c1-475a-ba8c-5c04b6ea0c86 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.812780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.813688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.814072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.814459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.819127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.880715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:24.916468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.918344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.922307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3367-39aa-4974-b1f0-42be7e9ca5c5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:24.926859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:24.927670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:24.927956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:24.928240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:24.932251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1078/2142] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:24.933360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:24.936595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:24.939492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:24.941143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:24.975815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1065/2143] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:25.010625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:25.099370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e06f-a040-40a6-9b07-1aad55f2cf08 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:25.104908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:25.105762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.106194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.106561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] PATH_INFO: `/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.107878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368ad516259a401ab6a7cf56e2e3d5f1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:25.110559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:25.154638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7e4c-a0e3-4ae8-a3b9-3ac7ccfa6c77 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:25.162932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:25.164864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.165273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.165619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] PATH_INFO: `/v3/users/8cb98bf6dad24fcda302a9f921b6db4f` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.169902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb98bf6dad24fcda302a9f921b6db4f)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:25.173200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:25.230448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368ad516259a401ab6a7cf56e2e3d5f1', 'request_id': 'req-b94d9209-daee-4d1d-9fea-a631b23827f8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.238035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368ad516259a401ab6a7cf56e2e3d5f1', 'request_id': 'req-b94d9209-daee-4d1d-9fea-a631b23827f8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.253546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368ad516259a401ab6a7cf56e2e3d5f1', 'request_id': 'req-b94d9209-daee-4d1d-9fea-a631b23827f8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.272168 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb98bf6dad24fcda302a9f921b6db4f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.282794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] The token cache is being invalidate because project 368ad516259a401ab6a7cf56e2e3d5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:25.283407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.284723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.286891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1079/2144] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:24 2022] DELETE /identity/v3/projects/368ad516259a401ab6a7cf56e2e3d5f1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:25.293517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:25.296312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.297984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb98bf6dad24fcda302a9f921b6db4f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.312762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb98bf6dad24fcda302a9f921b6db4f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.313624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb98bf6dad24fcda302a9f921b6db4f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.314299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-b92f3370-dab1-4172-a875-94bdc614c8f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb98bf6dad24fcda302a9f921b6db4f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.342984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1066/2145] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:25 2022] DELETE /identity/v3/users/8cb98bf6dad24fcda302a9f921b6db4f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:25.347611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b37bb-2f62-4113-841d-f2e376e790bb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.348054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b37bb-2f62-4113-841d-f2e376e790bb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.348519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b37bb-2f62-4113-841d-f2e376e790bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.388258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9209-daee-4d1d-9fea-a631b23827f8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:25.398655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:25.405556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:25.426146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6f2b37bb-2f62-4113-841d-f2e376e790bb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:25.458802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6f2b37bb-2f62-4113-841d-f2e376e790bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.474805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:25.475249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.475535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.475807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] PATH_INFO: `/v3/users/d762f36a3fa44c77a1e524aeb0218027` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.477327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d762f36a3fa44c77a1e524aeb0218027)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:25.479507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:25.502920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1067/2146] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:25.504654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190b32-50a2-47e3-bcc5-8dd75d3ebe23 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.504941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190b32-50a2-47e3-bcc5-8dd75d3ebe23 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.505234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190b32-50a2-47e3-bcc5-8dd75d3ebe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.577400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b0190b32-50a2-47e3-bcc5-8dd75d3ebe23 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:25.581727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b0190b32-50a2-47e3-bcc5-8dd75d3ebe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.596740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1068/2147] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:25.598082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.598367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.598616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd762f36a3fa44c77a1e524aeb0218027'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.598764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.614788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd762f36a3fa44c77a1e524aeb0218027'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.627470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd762f36a3fa44c77a1e524aeb0218027'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.628327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd762f36a3fa44c77a1e524aeb0218027'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.629374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:25.631878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.646064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f36f253b-f359-4b11-b29b-6f7bf13ed73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd762f36a3fa44c77a1e524aeb0218027'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:25.657998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1080/2148] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:25 2022] DELETE /identity/v3/users/d762f36a3fa44c77a1e524aeb0218027 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:25.661144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.661436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.661992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.664518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1069/2149] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:25.668798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:25.689788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d424d-00c3-491a-bea5-712bd07bcce0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:25.723680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:25.725262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.861275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1081/2150] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:25.861275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:25.862313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.876621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:25.877085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.877368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.877626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.878284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:25.878593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:25.892853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:25.912770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1070/2151] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:50:25.913955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:25.918110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:25.947882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:25.991020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16120-42a4-42a7-b930-ce6f21285013 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:25.994991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:25.995603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.995929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.996141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.000131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d3130-293b-4338-b5a0-52f90fa4d81d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.006846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.008323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.008935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.009821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.010159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.010478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.012432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.026463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1071/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:26.027179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.036419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.038614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.042707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ba87-90d9-4a1d-820d-af4bb1efb018 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.052108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.052706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.053036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.053399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.053956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.056054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.059657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1082/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:26.060603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.062189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.074980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b94d90-74d3-4e43-aef0-308a9105336f service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.081166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.082003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.082287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.082580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] PATH_INFO: `/v3/users/4e8cf175e30848558db4c8d8ef247e54` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.083731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8cf175e30848558db4c8d8ef247e54)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.085882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.107761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1072/2154] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:26.115890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.152538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8cf175e30848558db4c8d8ef247e54'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.166122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8cf175e30848558db4c8d8ef247e54'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.183403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8cf175e30848558db4c8d8ef247e54'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.185376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8cf175e30848558db4c8d8ef247e54'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.207924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8cf175e30848558db4c8d8ef247e54'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.215039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db59e-4cae-482a-865a-65cfe67e25bb admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.221541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1083/2155] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:26 2022] DELETE /identity/v3/users/4e8cf175e30848558db4c8d8ef247e54 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:26.222804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.223667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.223945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.224389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.224871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.227359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.238251 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:26.260388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1073/2156] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:26.261324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.264165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.346538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ad0d-9380-49c2-9516-cd16badaf24f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.351567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.352590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.352590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.352831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.353525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.355196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.371682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1084/2157] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:26.373369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.384158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3542-e702-4a39-960e-d33d672e970b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.390932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.391503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.391810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.392081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.393022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.394381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.408919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1074/2158] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:26.410636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.427606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275aa1a-7942-4c00-8b05-b8cdfb83aeff admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.433584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.434331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.434708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.435106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] PATH_INFO: `/v3/projects/3dde5d2d77f345be871f689aed54e755/users/70b5f69fcaa04ceca8d846aad103615a/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.466173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dde5d2d77f345be871f689aed54e755, user_id=70b5f69fcaa04ceca8d846aad103615a, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.471226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307482-9740-4fc1-acb0-c57b69dbe105 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.483192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.492198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.516389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1085/2159] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:26 2022] PUT /identity/v3/projects/3dde5d2d77f345be871f689aed54e755/users/70b5f69fcaa04ceca8d846aad103615a/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:26.527428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.528672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.529316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.536883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6469c9-facd-45e7-8c1a-6e92726c9dcc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.602532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] MFA Rules not processed for user `70b5f69fcaa04ceca8d846aad103615a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:26.603633 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.614698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:26.659524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.660101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.660373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.660647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] PATH_INFO: `/v3/projects/50cd8ecffa1c4fa0bebd78fbf7c2cfd7` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.665136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cd8ecffa1c4fa0bebd78fbf7c2cfd7)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.665136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.688046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1086/2160] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:26.689111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.690480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.705095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edfd77-7fa6-4424-8fd0-1922eccf378c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.710578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.711287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.711569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.711836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] PATH_INFO: `/v3/projects/cdd24cb59b6f418791aed7f2d2d02720` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.713294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd24cb59b6f418791aed7f2d2d02720)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.715235 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.724295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cd8ecffa1c4fa0bebd78fbf7c2cfd7', 'request_id': 'req-29336897-9218-40bc-9131-23527f70d599'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.731323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cd8ecffa1c4fa0bebd78fbf7c2cfd7', 'request_id': 'req-29336897-9218-40bc-9131-23527f70d599'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.738486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cd8ecffa1c4fa0bebd78fbf7c2cfd7', 'request_id': 'req-29336897-9218-40bc-9131-23527f70d599'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.755622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] The token cache is being invalidate because project 50cd8ecffa1c4fa0bebd78fbf7c2cfd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:26.755916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.756728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.758683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1075/2161] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:26 2022] DELETE /identity/v3/projects/50cd8ecffa1c4fa0bebd78fbf7c2cfd7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:26.759498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.760800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.768515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd24cb59b6f418791aed7f2d2d02720', 'request_id': 'req-df2ae38a-ef3c-4363-862f-96a2e1455e5d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.775842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd24cb59b6f418791aed7f2d2d02720', 'request_id': 'req-df2ae38a-ef3c-4363-862f-96a2e1455e5d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.785911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd24cb59b6f418791aed7f2d2d02720', 'request_id': 'req-df2ae38a-ef3c-4363-862f-96a2e1455e5d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.797942 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] The token cache is being invalidate because project cdd24cb59b6f418791aed7f2d2d02720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:26.798392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.799169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:26.800784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1087/2162] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:26 2022] DELETE /identity/v3/projects/cdd24cb59b6f418791aed7f2d2d02720 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:26.805361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.806834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.848743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336897-9218-40bc-9131-23527f70d599 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.866928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:26.881500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ae38a-ef3c-4363-862f-96a2e1455e5d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.886868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.887660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.888050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.888464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.889263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.891265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e18-1000-4e54-8887-88ed17f733cb admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.930931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1088/2163] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:26.933245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb8bd-78eb-4904-9ebf-bc12ecb07952 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.933616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb8bd-78eb-4904-9ebf-bc12ecb07952 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.934009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb8bd-78eb-4904-9ebf-bc12ecb07952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.935006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.935989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.936466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.936804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] PATH_INFO: `/v3/projects/41fb3d0666e141c7acb903752ab7a9a9` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.938947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fb3d0666e141c7acb903752ab7a9a9)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.953718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.961292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-099bb8bd-78eb-4904-9ebf-bc12ecb07952 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:26.962837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-099bb8bd-78eb-4904-9ebf-bc12ecb07952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.978924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.019108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fb3d0666e141c7acb903752ab7a9a9', 'request_id': 'req-56a597db-6e53-49b0-a642-17bd90021497'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:27.028165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fb3d0666e141c7acb903752ab7a9a9', 'request_id': 'req-56a597db-6e53-49b0-a642-17bd90021497'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:27.034826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fb3d0666e141c7acb903752ab7a9a9', 'request_id': 'req-56a597db-6e53-49b0-a642-17bd90021497'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:27.038295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1089/2164] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.039631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bd43-6665-428e-8232-ff8ee5e2d0be None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.039908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bd43-6665-428e-8232-ff8ee5e2d0be None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.040182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00bd43-6665-428e-8232-ff8ee5e2d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.055743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] The token cache is being invalidate because project 41fb3d0666e141c7acb903752ab7a9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:27.056198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:27.056867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:27.058676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1076/2165] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:26 2022] DELETE /identity/v3/projects/41fb3d0666e141c7acb903752ab7a9a9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:27.061846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.070424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.075646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6a00bd43-6665-428e-8232-ff8ee5e2d0be None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.077058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6a00bd43-6665-428e-8232-ff8ee5e2d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.142977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1090/2166] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.143291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a597db-6e53-49b0-a642-17bd90021497 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.147998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.148609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.148885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.149186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.150188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.150891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41ed9-f649-4a2b-ba16-f916fc036745 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.151182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41ed9-f649-4a2b-ba16-f916fc036745 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.151461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41ed9-f649-4a2b-ba16-f916fc036745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.152134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656dbf-fcd0-4b37-9fc4-1697e6a565af admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.173685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-acf41ed9-f649-4a2b-ba16-f916fc036745 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.174841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-acf41ed9-f649-4a2b-ba16-f916fc036745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.175898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1077/2167] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.177167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.177449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.177716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.183110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1091/2168] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.184758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.185080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.185649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.206584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.207773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.211948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.213156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.217440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1078/2169] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.218157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.222266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1092/2170] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.223089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.228819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f434d-63c0-41da-ae82-6d069d26f95c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.233438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec8876-214e-436e-b80f-c0a71fa49d7f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.234843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.235487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.235762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.236031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.236674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.238333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7101-6a25-471e-aa13-f102ff83b674 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.238475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.238961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.239387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.239677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.240339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:27.240646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.242375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.250444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1079/2171] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.252526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.252810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.253108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.259140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1093/2172] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:27.260090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.272518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc2f3-6147-4314-9274-910660a4b816 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.278045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.278187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.278784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.279221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.279328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.279503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.280160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:27.280464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.282097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.294449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1080/2173] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.295528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.300181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1094/2174] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:27.302101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.307525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8538-d737-428c-9b0d-014187b49ac5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.316716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.317420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.317697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.317968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.318619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.321368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105bb79-5ab2-4e46-9044-28b055658d58 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.323640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.328013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.328837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.329221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.330441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.331226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.333515 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.335382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1081/2175] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.336116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.341349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.347860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c5a2-5081-4e4e-a1f3-14e51aae8637 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.353471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.354268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.355428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.355941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.357464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:27.358108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.359990 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.369135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1095/2176] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.370021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.376043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1082/2177] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:27.376043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.388537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e53c1-b8ff-48aa-9e74-e755cd34e041 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.433609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.437752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527764ce-b4e1-4aaf-8529-a6c414361a3f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.443882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.444491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.444771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.445071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.445167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.445703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.445851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.446128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.446397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] PATH_INFO: `/v3/projects/92e8ff8de3654fada3e06c2efc705a0f/users/40a1f3c7bcb441889871d307023a5565/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.447694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.461513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e8ff8de3654fada3e06c2efc705a0f, user_id=40a1f3c7bcb441889871d307023a5565, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.464422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.477197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1096/2178] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.479409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1083/2179] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:27 2022] PUT /identity/v3/projects/92e8ff8de3654fada3e06c2efc705a0f/users/40a1f3c7bcb441889871d307023a5565/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:27.480437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.481649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.546961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1b7c-2a18-45fe-bf6a-5a0c792224c8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.551677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.552278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.552553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.552823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.553471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.553612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955fd4-12bb-46af-9082-0af84ecde3f8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.555373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.558240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.558848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.559134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.559503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.560443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.562434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27135df7-a061-46dd-aa62-6ad76d3cc2f1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.587564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1084/2180] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.587764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1097/2181] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.587860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.587947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.587947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.587947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.618720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] MFA Rules not processed for user `40a1f3c7bcb441889871d307023a5565`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.619968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.646140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.649913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df6e4-5695-4d04-b88d-d70e72877fb9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.655703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.656334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.656611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.656877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.657530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.659454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.682671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1085/2182] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.683474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.688940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1098/2183] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:27.689883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.696206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeabe1e-e3e8-4fd9-a0bd-79b4f85316f1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.700460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9436-22fb-43ee-b661-bf238540f8c9 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.701009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.701603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.701876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.702148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.702766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.705098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.706599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.707229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.707510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.707784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.708417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.710172 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.723365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1099/2184] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.724193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.727373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1086/2185] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.728218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.734469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55515a-c51f-4d65-875c-3c69e2eac611 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.738178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6026814-2ce0-49b1-b6ab-be3931ae01c7 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.739528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.740137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.740418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.740695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.741369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.742861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.742980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.743451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.743725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.743998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.744617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.746540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.753127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1100/2186] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.753928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.763873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8af9f-5e07-4351-a617-a58fd271df2a admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.769182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.769788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.770070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.770385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.771104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.772765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.782669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1087/2187] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.783474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.792845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1101/2188] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.792845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.801332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90f21b-be41-41d2-8016-030bf4a27774 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.830545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.851154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347b7c-02e8-4d3d-a445-4428bd055bd3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.855795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.856570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.856848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.857146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.857788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.859397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.865090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.866149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.866433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.866708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.867394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.868956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.873775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1088/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.873775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.883944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1102/2190] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:27.883944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.887445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c737c-71c6-45a3-8b60-6d683c778edc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.892668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.893503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.893796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.894066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.894709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.894840 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7459e-bb9a-44a7-adf1-e0b2445477c5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.896940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.899312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:27.899973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.900250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.900517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] PATH_INFO: `/v3/projects/ad68e0fd721a4d5e9fddcd41eb37e529/users/451642ac992f491fa8bcada886dfc1fe/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.919772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad68e0fd721a4d5e9fddcd41eb37e529, user_id=451642ac992f491fa8bcada886dfc1fe, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:27.925348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:27.925507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1089/2191] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:27.925507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:27.933650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2494da-baac-4841-b0d1-45946141bdf2 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:27.940882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1103/2192] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:27 2022] PUT /identity/v3/projects/ad68e0fd721a4d5e9fddcd41eb37e529/users/451642ac992f491fa8bcada886dfc1fe/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:27.941946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.005406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.006055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.006377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.006700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.007422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.009189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.014336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45fd7-bd6a-4252-a92c-c49028bcb1cc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.019401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.020173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.020476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1090/2193] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:28.021384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.023664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.024039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] PATH_INFO: `/v3/projects/cb8699318128426d9bfb6310e019ecb4/users/403abcd329c845089083a84cc877ec41/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.031721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be324c-6dcc-4cb2-af43-16a572cfd901 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.037585 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.037892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.038174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.038681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.039098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.040894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084022-f7f8-4d17-8024-a7721a0ce4d0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.042675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8699318128426d9bfb6310e019ecb4, user_id=403abcd329c845089083a84cc877ec41, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.046226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.057432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1091/2194] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:28.057432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.057432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.057432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.065232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1104/2195] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:27 2022] PUT /identity/v3/projects/cb8699318128426d9bfb6310e019ecb4/users/403abcd329c845089083a84cc877ec41/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:28.065608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.082979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.092692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] MFA Rules not processed for user `451642ac992f491fa8bcada886dfc1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:28.094509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.158561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df4bbb-0238-4ee4-bbf1-ecef65cc2aae admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.165276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.166071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.166359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.166634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] PATH_INFO: `/v3/projects/5ba671295b8d43d385b6b42cd02297c4/users/2462d74d99e347349a1897fcd54185b6/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.181121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1092/2196] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.182775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.191407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba671295b8d43d385b6b42cd02297c4, user_id=2462d74d99e347349a1897fcd54185b6, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.194780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f2eb5-53f1-4097-836b-bed35f375fd7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.196280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa737d0a-eb47-4695-ac01-049dfa28b36a None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.202639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.203692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.204088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.204494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] PATH_INFO: `/v3/projects/62e704e9aeb44a25a7e800bfbbb63113/users/5318dd1dfdc74b0fa897490ef9972570/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.221217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1105/2197] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:28 2022] PUT /identity/v3/projects/5ba671295b8d43d385b6b42cd02297c4/users/2462d74d99e347349a1897fcd54185b6/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:28.223769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b113-bb6e-49ae-9c76-b0cd35eaf701 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.224299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b113-bb6e-49ae-9c76-b0cd35eaf701 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.224299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b113-bb6e-49ae-9c76-b0cd35eaf701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.229314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e704e9aeb44a25a7e800bfbbb63113, user_id=5318dd1dfdc74b0fa897490ef9972570, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.233294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.245773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.256319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d758b113-bb6e-49ae-9c76-b0cd35eaf701 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:28.260189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1093/2198] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:28 2022] PUT /identity/v3/projects/62e704e9aeb44a25a7e800bfbbb63113/users/5318dd1dfdc74b0fa897490ef9972570/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:28.260330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d758b113-bb6e-49ae-9c76-b0cd35eaf701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.260423 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.260954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.331584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200266e3-159b-40ae-91d1-2830d8ab9359 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.335778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1106/2199] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.335928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.336415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.336699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.337019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.340133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.340502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.341386 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.368781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] MFA Rules not processed for user `2462d74d99e347349a1897fcd54185b6`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:28.370033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.404999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.406923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.418074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1094/2200] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:28.419275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.434741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee3b5-39aa-4aee-b8f4-c305b6d7c8b6 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.444207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.444994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.445368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.445738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.446550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.448262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.450155 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1107/2201] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.451185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.452811 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.466828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1095/2202] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:28.466828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.487499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249cb6-349f-43c9-addf-22968ebffdef admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.498110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.498920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.499680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.501360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.502330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.504702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.532511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.545921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1096/2203] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:28.546667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.550420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2969d0e-6f90-42f4-9aed-7615945620d2 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.626157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.627008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.627272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.627419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aafe8-ac0b-40f9-9173-419b59f393a0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.627599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.632984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.633761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.634257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.634645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] PATH_INFO: `/v3/projects/62e704e9aeb44a25a7e800bfbbb63113/users/5318dd1dfdc74b0fa897490ef9972570/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.637084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e704e9aeb44a25a7e800bfbbb63113, user_id=5318dd1dfdc74b0fa897490ef9972570, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.637244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.640216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.640816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.642312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44bce8-bc8c-41ec-8f51-dbfd85f853bc service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.652111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1097/2204] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:28 2022] PUT /identity/v3/projects/62e704e9aeb44a25a7e800bfbbb63113/users/5318dd1dfdc74b0fa897490ef9972570/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:28.653345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.659454 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1108/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:28.664050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.665158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.671084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.720598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] MFA Rules not processed for user `5318dd1dfdc74b0fa897490ef9972570`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:28.722396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.774111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb9221-7336-40de-a33e-e65d659319bc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.780162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.780798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.781121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.781398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.782805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.785512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.819782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1098/2206] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:28.823731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.840860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c89bc-0082-43a1-b03a-9c167028ad28 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.846654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.847280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.847661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.847941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.848595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.850338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.864572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1099/2207] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:28.869188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.886183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf8f7-387a-4c32-a662-506a361b38bc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.886388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1109/2208] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.897195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.898518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.899005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.899433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] PATH_INFO: `/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d/users/b95b4055835349548838a93733a4d3db/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.913613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.931425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90778d1cc4b4745bcc8dc703e064a5d, user_id=b95b4055835349548838a93733a4d3db, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:28.935124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:28.956540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1100/2209] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:28 2022] PUT /identity/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d/users/b95b4055835349548838a93733a4d3db/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:28.962155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.040766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.043417 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a72ce-a000-4ea0-af94-40a3c56a2e0b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.060760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a103a-c006-4071-b9b2-c09575e2e74c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.070507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.071835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.072326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.072991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.073899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.077255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.113680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1101/2210] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:29.115017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.136844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615f4b-1033-421c-9b73-a8038761ae55 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.149828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.150550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.150927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.151668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.155206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.155896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.156193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.156506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] PATH_INFO: `/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d/users/b95b4055835349548838a93733a4d3db/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.160522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90778d1cc4b4745bcc8dc703e064a5d, user_id=b95b4055835349548838a93733a4d3db, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.164455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c239-e31b-4431-9e4b-f3aaed3bd1c9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.181005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1102/2211] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:29 2022] PUT /identity/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d/users/b95b4055835349548838a93733a4d3db/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:29.191291 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.191631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.191916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.217721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.232809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.234282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] MFA Rules not processed for user `b95b4055835349548838a93733a4d3db`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:29.234481 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.235812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.244661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1110/2212] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:29.300403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.301931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.322503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b958-9b77-4d3d-baf7-041bf7341ca6 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.327377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1103/2213] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:29.399825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.400533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.400953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.401187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.403547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.408687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.420457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060854c8-47f7-44f1-9705-8e1d23a7a3f3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.424315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.425162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.425443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.425715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.441776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.443772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.454612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1104/2214] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:29.477139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.479788 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.494557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1111/2215] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:29.499157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.586549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524583-e445-4642-9e0c-2a4bfb20b034 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.594088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.594550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.594919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.595296 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] PATH_INFO: `/v3/users/2462d74d99e347349a1897fcd54185b6` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.597010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2462d74d99e347349a1897fcd54185b6)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.599140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.606787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.608716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.639433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7937-5ffb-474f-b9db-84a3a3437f07 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.644594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.645461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.645737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.646015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] PATH_INFO: `/v3/users/00786ea0d3c3433691453d29ce20c3d8` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.647274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00786ea0d3c3433691453d29ce20c3d8)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.649533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.702394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.706676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2462d74d99e347349a1897fcd54185b6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.726470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2462d74d99e347349a1897fcd54185b6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.731594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00786ea0d3c3433691453d29ce20c3d8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.740908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2462d74d99e347349a1897fcd54185b6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.741818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2462d74d99e347349a1897fcd54185b6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.742558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9eeb9981-4de2-4145-b757-cabcf5b6aed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2462d74d99e347349a1897fcd54185b6'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.746741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00786ea0d3c3433691453d29ce20c3d8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.757916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00786ea0d3c3433691453d29ce20c3d8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.758998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00786ea0d3c3433691453d29ce20c3d8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.764814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1105/2216] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:29 2022] DELETE /identity/v3/users/2462d74d99e347349a1897fcd54185b6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:29.766231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423671da-55e2-40f4-a63e-842453895e6e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.766649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423671da-55e2-40f4-a63e-842453895e6e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.766928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423671da-55e2-40f4-a63e-842453895e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.775238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fa1c9532-0927-4ad7-84ef-aeade2f634f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00786ea0d3c3433691453d29ce20c3d8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:29.787730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1112/2217] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:29 2022] DELETE /identity/v3/users/00786ea0d3c3433691453d29ce20c3d8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:29.789108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-423671da-55e2-40f4-a63e-842453895e6e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:29.789558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.789729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.789976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.790634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-423671da-55e2-40f4-a63e-842453895e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.815691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:29.817171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.831871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.911204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1106/2218] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:29.921449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1113/2219] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:29.922526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423671da-55e2-40f4-a63e-842453895e6e None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.923930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-423671da-55e2-40f4-a63e-842453895e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.937581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.939897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:30.006905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423671da-55e2-40f4-a63e-842453895e6e None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:30.022071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:30.022071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:30.022071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:30.022071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:30.058287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:30.060565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:30.090901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1107/2220] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:30.097306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02ed2b-8214-4583-80a1-9c596556fb9e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:30.108399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:30.109220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:30.110609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:30.111004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:30.134234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:30.141215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:30.168289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1114/2221] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:30.675940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:30.677607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:30.698886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4f54-af9e-4778-bc95-377388520e89 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:30.720260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:30.721484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:30.722613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:30.723206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] PATH_INFO: `/v3/projects/5ba671295b8d43d385b6b42cd02297c4` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:30.724824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba671295b8d43d385b6b42cd02297c4)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:30.727431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:30.773925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:30.775822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:30.845188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba671295b8d43d385b6b42cd02297c4', 'request_id': 'req-7841cf36-6189-424c-8791-f464818bc946'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:30.855086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba671295b8d43d385b6b42cd02297c4', 'request_id': 'req-7841cf36-6189-424c-8791-f464818bc946'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:30.863265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:30.866205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba671295b8d43d385b6b42cd02297c4', 'request_id': 'req-7841cf36-6189-424c-8791-f464818bc946'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:30.908822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] The token cache is being invalidate because project 5ba671295b8d43d385b6b42cd02297c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:30.921193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:30.930938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:30.934024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1108/2222] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:30 2022] DELETE /identity/v3/projects/5ba671295b8d43d385b6b42cd02297c4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:30.937264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b7622-4f6a-4164-9e92-ef2be6974e67 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:30.938816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:30.941003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.032316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841cf36-6189-424c-8791-f464818bc946 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:31.048420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:31.049257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.049651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.049979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] PATH_INFO: `/v3/projects/1f3ea2b578ee448abf846909895ff112` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.051170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3ea2b578ee448abf846909895ff112)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:31.053658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:31.055285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:31.055964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.056254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.056641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.058792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.094688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:31.126341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3ea2b578ee448abf846909895ff112', 'request_id': 'req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.148795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:31.148795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:31.179658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3ea2b578ee448abf846909895ff112', 'request_id': 'req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.182764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1115/2223] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:31.183919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:31.186137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.194546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3ea2b578ee448abf846909895ff112', 'request_id': 'req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.228821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305e77-56ce-4bc5-ab5d-8c3689dd14b4 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:31.229051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] The token cache is being invalidate because project 1f3ea2b578ee448abf846909895ff112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:31.229511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.230616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.234310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1109/2224] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:30 2022] DELETE /identity/v3/projects/1f3ea2b578ee448abf846909895ff112 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:31.239072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:31.242455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.377179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:31.377879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.378220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.378504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] PATH_INFO: `/v3/users/b95b4055835349548838a93733a4d3db` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.379966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95b4055835349548838a93733a4d3db)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:31.382651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:31.394352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916139a-c7d5-4321-bf5d-8f34caaa3e5a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:31.407258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:31.407923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.408244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.408468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] PATH_INFO: `/v3/users/0bd99526150d470298639589cb30cd90` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.410518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd99526150d470298639589cb30cd90)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:31.416278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:31.469136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:31.474804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95b4055835349548838a93733a4d3db'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.494413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95b4055835349548838a93733a4d3db'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.517969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95b4055835349548838a93733a4d3db'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.518842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95b4055835349548838a93733a4d3db'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.521545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd99526150d470298639589cb30cd90'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.540506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd99526150d470298639589cb30cd90'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.548283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95b4055835349548838a93733a4d3db'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.556212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd99526150d470298639589cb30cd90'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.557182 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd99526150d470298639589cb30cd90'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.558809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-be77cf52-e722-46b4-9de3-495cd9887f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd99526150d470298639589cb30cd90'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.566771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1116/2225] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:31 2022] DELETE /identity/v3/users/b95b4055835349548838a93733a4d3db => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:31.569147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:31.585977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.594955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1110/2226] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:31 2022] DELETE /identity/v3/users/0bd99526150d470298639589cb30cd90 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:31.671948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:31.702925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659cd9-c966-43e3-ad69-ee57d07c542c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:31.800198 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:31.801326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.802247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.802889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] PATH_INFO: `/v3/users/451642ac992f491fa8bcada886dfc1fe` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.805592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451642ac992f491fa8bcada886dfc1fe)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:31.808463 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:31.934889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451642ac992f491fa8bcada886dfc1fe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.961574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451642ac992f491fa8bcada886dfc1fe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.994062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451642ac992f491fa8bcada886dfc1fe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:31.996833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451642ac992f491fa8bcada886dfc1fe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.030823 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451642ac992f491fa8bcada886dfc1fe'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.050829 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1117/2227] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:31 2022] DELETE /identity/v3/users/451642ac992f491fa8bcada886dfc1fe => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:32.055754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.056726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.057280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.068897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.073799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.111876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:32.116381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.225377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f90c-6689-4e4b-9849-dd49bbd347d4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.231817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:32.234354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.234894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.235409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] PATH_INFO: `/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.237002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90778d1cc4b4745bcc8dc703e064a5d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:32.240827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:32.256866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:32.268649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1111/2228] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:32.281880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.284743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.347005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90778d1cc4b4745bcc8dc703e064a5d', 'request_id': 'req-4162f61b-79e5-4ab2-87c0-9b5b4e164303'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.365521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90778d1cc4b4745bcc8dc703e064a5d', 'request_id': 'req-4162f61b-79e5-4ab2-87c0-9b5b4e164303'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.387678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90778d1cc4b4745bcc8dc703e064a5d', 'request_id': 'req-4162f61b-79e5-4ab2-87c0-9b5b4e164303'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.391900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5f7c8-a846-4980-8845-934447a3cb9e None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.404321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] The token cache is being invalidate because project f90778d1cc4b4745bcc8dc703e064a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:32.404862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.407289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4162f61b-79e5-4ab2-87c0-9b5b4e164303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:32.429358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1118/2229] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:32 2022] DELETE /identity/v3/projects/f90778d1cc4b4745bcc8dc703e064a5d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:32.440205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161d15-2b76-4281-a93b-4f8e153ed1a2 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.441403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161d15-2b76-4281-a93b-4f8e153ed1a2 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.441709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161d15-2b76-4281-a93b-4f8e153ed1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.520661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ea161d15-2b76-4281-a93b-4f8e153ed1a2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:32.525303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ea161d15-2b76-4281-a93b-4f8e153ed1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.576316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:32.577821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.578099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.578650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.583822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.600573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:32.657865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1119/2230] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:32.659676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.660431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.660779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.702578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:32.703915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.723118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1120/2231] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:32.727736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.737367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:32.738940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:32.751203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623d5e-5a10-40e0-afd7-0d0d33889a51 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.756111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1112/2232] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:32.764348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:32.765254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.765709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.766123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.766935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:32.767380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:32.769241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:32.788884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1121/2233] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:32.793547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.806860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2a8ce-38a0-4248-9db3-2dd2687e0ecc service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.812633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:32.813369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.813643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.813916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.814874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:32.817103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:32.851346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.853449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.872066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a640-ad18-47d2-bffa-c25af5a2caf1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.877677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1113/2234] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:32 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:32.879429 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.007851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.008529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.009073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.009354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] PATH_INFO: `/v3/projects/8a96f082d0664b74a6cb591763173450` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.015597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a96f082d0664b74a6cb591763173450)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.017984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.054781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:33.059058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704da-7a2e-4365-9134-5e85d11e6ee8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.066906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.067924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.068090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.068475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.069978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.072628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.123487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1114/2235] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:32 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:33.127056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.139144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a96f082d0664b74a6cb591763173450', 'request_id': 'req-8e38bd03-f3bf-4410-8972-dc053ce4ded2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.163089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde9d7-fad2-429e-a3a3-82f008f90edd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.171624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a96f082d0664b74a6cb591763173450', 'request_id': 'req-8e38bd03-f3bf-4410-8972-dc053ce4ded2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.194743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a96f082d0664b74a6cb591763173450', 'request_id': 'req-8e38bd03-f3bf-4410-8972-dc053ce4ded2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.211542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] The token cache is being invalidate because project 8a96f082d0664b74a6cb591763173450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:33.211896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.212534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e38bd03-f3bf-4410-8972-dc053ce4ded2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.218409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1122/2236] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:32 2022] DELETE /identity/v3/projects/8a96f082d0664b74a6cb591763173450 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:33.220110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.222564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.222899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.281915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:33.285576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.310134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.310763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.311173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.311361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.312021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.313703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.333908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1115/2237] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:33.337918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.342454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.361445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249cb3-51f9-4843-b68b-35e6cfc0a200 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.368847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.370716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.370716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.370716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.371462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.373734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.375444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:33.392132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1116/2238] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:33.397024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.411645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274b005-faf3-4214-b800-2bf15e8c5cb0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.417765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.418677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.419307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.419803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] PATH_INFO: `/v3/projects/758c27a6ef5040158ab64524193f1e63/users/fe00be41c3c340fa914f8a1e8603928f/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.441867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c27a6ef5040158ab64524193f1e63, user_id=fe00be41c3c340fa914f8a1e8603928f, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.445548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.452212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1123/2239] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:33.453350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.455598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.466706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1117/2240] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:33 2022] PUT /identity/v3/projects/758c27a6ef5040158ab64524193f1e63/users/fe00be41c3c340fa914f8a1e8603928f/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:33.467980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.469082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27070c93-3fc9-490e-82fa-ba05b717580d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.471226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.579621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ff34-0832-4fca-a1ed-b56ec2ccef44 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.580448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.581196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.581562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.581895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] PATH_INFO: `/v3/projects/ad68e0fd721a4d5e9fddcd41eb37e529` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.583330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad68e0fd721a4d5e9fddcd41eb37e529)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.585563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.586488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.586646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.586965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.587303 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] PATH_INFO: `/v3/users/70b5f69fcaa04ceca8d846aad103615a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.588512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b5f69fcaa04ceca8d846aad103615a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.590622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:33.652538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad68e0fd721a4d5e9fddcd41eb37e529', 'request_id': 'req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.655150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:33.656495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b5f69fcaa04ceca8d846aad103615a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.660056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad68e0fd721a4d5e9fddcd41eb37e529', 'request_id': 'req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.672915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad68e0fd721a4d5e9fddcd41eb37e529', 'request_id': 'req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.687113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b5f69fcaa04ceca8d846aad103615a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.689531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] The token cache is being invalidate because project ad68e0fd721a4d5e9fddcd41eb37e529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:33.690224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.691146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-b8b3279a-9d96-4b91-8c1f-5b11a32c9505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.693759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1124/2241] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:33 2022] DELETE /identity/v3/projects/ad68e0fd721a4d5e9fddcd41eb37e529 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:33.698589 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b5f69fcaa04ceca8d846aad103615a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.698878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211713f3-923b-4bfa-954c-d0d2c95c7f08 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.699113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211713f3-923b-4bfa-954c-d0d2c95c7f08 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.699415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211713f3-923b-4bfa-954c-d0d2c95c7f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.699575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b5f69fcaa04ceca8d846aad103615a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.700313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f0cb861-92e5-4bb8-962d-30aa53ea1423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b5f69fcaa04ceca8d846aad103615a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:33.724556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-211713f3-923b-4bfa-954c-d0d2c95c7f08 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:33.725853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-211713f3-923b-4bfa-954c-d0d2c95c7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.740613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1118/2242] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:33 2022] DELETE /identity/v3/users/70b5f69fcaa04ceca8d846aad103615a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:33.742584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978a50-bf44-4765-920e-f0930b9972eb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.744683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978a50-bf44-4765-920e-f0930b9972eb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.745008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978a50-bf44-4765-920e-f0930b9972eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.787829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-bc978a50-bf44-4765-920e-f0930b9972eb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:33.793446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bc978a50-bf44-4765-920e-f0930b9972eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.807917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1125/2243] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:33.809685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.809978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.810412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.843759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:33.846117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.899081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:33.921495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1119/2244] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:33.923381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.923863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.924401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.948067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:33.949544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.956299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1126/2245] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:33.957471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.959954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1120/2246] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:33.960936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:33.972342 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:33.975727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c432-ca74-4979-91c5-758fd58d0ab4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:33.992923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:33.993671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:33.993953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:33.994223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:33.994890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:33.995191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:33.996875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171cff-628b-492e-95f6-5c60d2a790a0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.010684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1127/2247] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:34.011884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.012242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.012581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.045480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:34.047413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:34.063150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379a07-bb15-43c9-a7f6-ba28bec495f3 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.064019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1128/2248] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:34.065044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.077319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.077964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.078239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.078507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.085687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c0517-e313-42fc-8bad-bed173d03598 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.089374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.091790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.092061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.092703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.093152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.093423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.103650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1121/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:34.104480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.108901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.111003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.124586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abc8f-d8b9-497c-a541-bf0627ec17d8 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.127604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1129/2250] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:34.128748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.131167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.131834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.132119 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.132389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.134042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.139718 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.144006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3de3-0603-4638-b7ad-718ee57e85f0 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.152324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.153352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.154303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.154759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.156819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:34.157281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.162496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.188156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1130/2251] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:34.192926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.201305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1122/2252] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:34.203011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.204531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02802d4-263c-4d28-8e30-440ae067312d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.262490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:34.360389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56103-3457-4500-bf97-bba6640f62da admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.372245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.374334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.374334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.374635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.375882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.379809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.383567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.384050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.385490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.385608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.386512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.390699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.447370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1123/2253] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:34.449006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1131/2254] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/projects => generated 395 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:34.450254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.452804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.487501 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443dd1-da35-44df-8793-536ef45bea74 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.588404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:34.604474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad169-dacb-46ef-88d7-e83d741e5c9b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.616709 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.617401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.617734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.617945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.618681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.620336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.622862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.623778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.624900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.625536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.626618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.628890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.643479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1132/2255] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:34.648280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.673557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1124/2256] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:34.676416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.678422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c8ce-4d75-4001-b2b0-af08513e64e4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.692509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.692923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.693236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.693504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.694159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.696551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a19f2-c35b-4c99-b535-1b2a07e16d15 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.698176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.708954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.711709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.711906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.712094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.713761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.719458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.727875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1133/2257] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:34.732112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.749277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1125/2258] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:34.754355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.758832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a436-1a51-4cf4-9a94-bf6ed9f7b60e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.770752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.770752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.771073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.771809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] PATH_INFO: `/v3/projects/969be32561494264a08295bf60bfa96d/users/118ffadb18814d3fab3a7f4a20dec43c/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.777240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bdd7b-18d9-4de8-860e-3539dbaab6cb admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.787400 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.788035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.788300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.790882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.790882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.792535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.807410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1126/2259] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:34.811351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:34.815631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=969be32561494264a08295bf60bfa96d, user_id=118ffadb18814d3fab3a7f4a20dec43c, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:34.818551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a680-d68a-4198-9624-6ca66addae0f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:34.828516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac64-d560-4fc8-a4df-0891f12bc2df admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:34.840871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1134/2260] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:34 2022] PUT /identity/v3/projects/969be32561494264a08295bf60bfa96d/users/118ffadb18814d3fab3a7f4a20dec43c/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:34.855552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128db3d-c25b-4d62-977f-7dcbb43e3dc5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.856223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128db3d-c25b-4d62-977f-7dcbb43e3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.856564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128db3d-c25b-4d62-977f-7dcbb43e3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.901804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6128db3d-c25b-4d62-977f-7dcbb43e3dc5 None None] MFA Rules not processed for user `118ffadb18814d3fab3a7f4a20dec43c`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:34.903092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6128db3d-c25b-4d62-977f-7dcbb43e3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:34.968298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:34.970414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.971036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.972436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] PATH_INFO: `/v3/projects/0cb974150bcd4816a91e38849160f79e/users/98686737869f4f1885a35f731de6f233/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.002463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb974150bcd4816a91e38849160f79e, user_id=98686737869f4f1885a35f731de6f233, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.007139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.045734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1127/2261] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:34 2022] PUT /identity/v3/projects/0cb974150bcd4816a91e38849160f79e/users/98686737869f4f1885a35f731de6f233/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:35.045734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.071375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.089214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1135/2262] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:35.090631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.090977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.091188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.132281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:35.142609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] MFA Rules not processed for user `98686737869f4f1885a35f731de6f233`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:35.145009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.180637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4e14d-5770-46bc-bf4f-c09bf64a6c82 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.212747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.213729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.214011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.214304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] PATH_INFO: `/v3/projects/3dde5d2d77f345be871f689aed54e755` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.219195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dde5d2d77f345be871f689aed54e755)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.222162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.259780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1136/2263] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:35.261500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.276419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520c41-4d2e-4fcd-8e43-2f85bb15ca67 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.303866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:35.309693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dde5d2d77f345be871f689aed54e755', 'request_id': 'req-bd277982-e08e-4b56-985c-99aa59b3416f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.332144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dde5d2d77f345be871f689aed54e755', 'request_id': 'req-bd277982-e08e-4b56-985c-99aa59b3416f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.358914 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dde5d2d77f345be871f689aed54e755', 'request_id': 'req-bd277982-e08e-4b56-985c-99aa59b3416f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.400081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] The token cache is being invalidate because project 3dde5d2d77f345be871f689aed54e755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:35.400805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.401676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.403687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1128/2264] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:35 2022] DELETE /identity/v3/projects/3dde5d2d77f345be871f689aed54e755 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:35.405977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.409437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.419181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.420148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.421345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.421801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.423185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.425828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.466931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1137/2265] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:35 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:35.469168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.471025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.511508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277982-e08e-4b56-985c-99aa59b3416f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.597877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.599153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.599594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.600044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.603001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.658700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435df1-a19b-4d53-8d12-41e803b5385f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.672482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.673570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.674208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.674645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] PATH_INFO: `/v3/users/40a1f3c7bcb441889871d307023a5565` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.676121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a1f3c7bcb441889871d307023a5565)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.681041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.718907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.721644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.735909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1129/2266] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:35 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:35.737955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.739480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.759130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162829-d0e3-4e14-b371-a95b6bc58759 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.762665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:35.767229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.768458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.768848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.769240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.770128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.778796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.803596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a1f3c7bcb441889871d307023a5565'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.817317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1130/2267] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:35 2022] POST /identity/v3/users => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:35.819076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.820924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a1f3c7bcb441889871d307023a5565'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.833351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ea6a-2ab8-4172-a36c-37f292ee85e5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.842274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a1f3c7bcb441889871d307023a5565'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.843139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a1f3c7bcb441889871d307023a5565'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.865770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a1f3c7bcb441889871d307023a5565'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:35.869248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.870297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.870729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.871150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.873586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.876239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322664a9-002a-4550-bd8d-2375b8c9318d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.877233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1138/2268] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:35 2022] DELETE /identity/v3/users/40a1f3c7bcb441889871d307023a5565 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:35.916229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1131/2269] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:35.919585 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.922926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:36.129944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6cc44-4a2e-4a81-9279-b54033521116 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:36.151913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:36.153129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.153129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.153318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] PATH_INFO: `/v3/projects/4bfca50b606b404a933268f353d30d2b/users/81b00e9c8a1f42f499bf5a6c345f699a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:36.202087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfca50b606b404a933268f353d30d2b, user_id=81b00e9c8a1f42f499bf5a6c345f699a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:36.213385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:36.217022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.218602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.219115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:36.250259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1139/2270] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:35 2022] PUT /identity/v3/projects/4bfca50b606b404a933268f353d30d2b/users/81b00e9c8a1f42f499bf5a6c345f699a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:36.251430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:36.292770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] MFA Rules not processed for user `fe00be41c3c340fa914f8a1e8603928f`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:36.294283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:36.313084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:36.485743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2b6ad-acd4-4325-a583-278c74c72183 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:36.529775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:36.530526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.530812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.531079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:36.535423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:36.541066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:36.576362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1140/2271] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:36.581510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:36.585369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1132/2272] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:36.602184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:36.603488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:36.629527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243624de-9be1-42d0-898f-e9c5d63f7605 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:36.644104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:36.645071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.645361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.645665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] PATH_INFO: `/v3/projects/4bfca50b606b404a933268f353d30d2b/users/81b00e9c8a1f42f499bf5a6c345f699a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:36.649887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfca50b606b404a933268f353d30d2b, user_id=81b00e9c8a1f42f499bf5a6c345f699a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:36.658933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654f955-9dd0-44c2-aaeb-37bf6107042f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:36.693779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1141/2273] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:36 2022] PUT /identity/v3/projects/4bfca50b606b404a933268f353d30d2b/users/81b00e9c8a1f42f499bf5a6c345f699a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:36.706924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.716026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.721627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:36.787006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26b069-d621-40eb-946d-56e571c0d26b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:36.826419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:36.878168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] MFA Rules not processed for user `81b00e9c8a1f42f499bf5a6c345f699a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:36.880257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:36.949074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:36.949816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:36.950298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:36.950587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.106008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.109244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.133375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1133/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:37.134481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.139791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.177221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:37.194363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1142/2275] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:37.205932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.210943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.241277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4673-11ac-463b-baa4-7445ffa28e93 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.251365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.252119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.252529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.252802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.272024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.274326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7d352-fb86-4ae8-8dad-0e33c49becc4 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.293178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4855a-faff-47b4-a5ea-de3b015d0fe4 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.297899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1143/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:37.312026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.312727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.313089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.313367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] PATH_INFO: `/v3/projects/92e8ff8de3654fada3e06c2efc705a0f` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.315917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e8ff8de3654fada3e06c2efc705a0f)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.329991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.349056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.349643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.349928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.392475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] MFA Rules not processed for user `403abcd329c845089083a84cc877ec41`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:37.393831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.446290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e8ff8de3654fada3e06c2efc705a0f', 'request_id': 'req-3fecbcba-22e6-4559-a26a-a421cc4db208'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.453885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e8ff8de3654fada3e06c2efc705a0f', 'request_id': 'req-3fecbcba-22e6-4559-a26a-a421cc4db208'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.461046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e8ff8de3654fada3e06c2efc705a0f', 'request_id': 'req-3fecbcba-22e6-4559-a26a-a421cc4db208'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.492698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] The token cache is being invalidate because project 92e8ff8de3654fada3e06c2efc705a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:37.493503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.494204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.500689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1134/2277] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:37 2022] DELETE /identity/v3/projects/92e8ff8de3654fada3e06c2efc705a0f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:37.501776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.503310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.512062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1144/2278] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:37.512062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.523405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991222e-58ae-45be-963d-95128c3c0926 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.585431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbcba-22e6-4559-a26a-a421cc4db208 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.589593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.590852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.591239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.591932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.593686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.612141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.612806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.613125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.613394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] PATH_INFO: `/v3/users/5318dd1dfdc74b0fa897490ef9972570` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.615290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5318dd1dfdc74b0fa897490ef9972570)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.617544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.639383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:37.686725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5318dd1dfdc74b0fa897490ef9972570'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.689164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.690321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.696820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5318dd1dfdc74b0fa897490ef9972570'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.701954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1135/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:37.702941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.704313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.718727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5318dd1dfdc74b0fa897490ef9972570'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.719393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:37.719872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5318dd1dfdc74b0fa897490ef9972570'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.726688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd85eb-dc56-49e1-9ed6-911fa1922047 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.736612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5318dd1dfdc74b0fa897490ef9972570'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:37.740417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.741233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.741674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.742015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.743365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.745834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.748547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1145/2280] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:37 2022] DELETE /identity/v3/users/5318dd1dfdc74b0fa897490ef9972570 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:37.785131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1136/2281] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:37 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:37.786517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:37.788291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.862835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747178-c7aa-4b19-8627-08206b3d144e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:37.941254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:37.941986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.942415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.942818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.943789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:37.946678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:37.985716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1146/2282] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:37 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:37.987545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.001165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0b340-f192-4a83-b523-19f04c3d922c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.024732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.025278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.025555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.026223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.026946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.029269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.051840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1137/2283] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:38.056404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.070077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cacb-8e4b-40b7-9bdc-2a3bf0966d03 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.078953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.080784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.081193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.081591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] PATH_INFO: `/v3/projects/d297918c42164292928e9116057e333c/users/a4505a1d5d2f47f795eb55a1d6bec5d8/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.105098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.108211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.128377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297918c42164292928e9116057e333c, user_id=a4505a1d5d2f47f795eb55a1d6bec5d8, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.141858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41678b-a717-4eb2-afd0-aa04755c4f3b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.142712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.156529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.157153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.157442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.157931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] PATH_INFO: `/v3/projects/62e704e9aeb44a25a7e800bfbbb63113` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.168422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1147/2284] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:38 2022] PUT /identity/v3/projects/d297918c42164292928e9116057e333c/users/a4505a1d5d2f47f795eb55a1d6bec5d8/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:38.172127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e704e9aeb44a25a7e800bfbbb63113)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.172656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.174255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.180091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:38.271017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e704e9aeb44a25a7e800bfbbb63113', 'request_id': 'req-4c0f73b8-9267-4761-9152-65a86ce830fa'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:38.281464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9560-027e-453b-9615-fc14ef1f735e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.288245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e704e9aeb44a25a7e800bfbbb63113', 'request_id': 'req-4c0f73b8-9267-4761-9152-65a86ce830fa'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:38.296136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e704e9aeb44a25a7e800bfbbb63113', 'request_id': 'req-4c0f73b8-9267-4761-9152-65a86ce830fa'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:38.315720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] The token cache is being invalidate because project 62e704e9aeb44a25a7e800bfbbb63113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:38.315963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:38.316631 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4c0f73b8-9267-4761-9152-65a86ce830fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:38.320126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1138/2285] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:38 2022] DELETE /identity/v3/projects/62e704e9aeb44a25a7e800bfbbb63113 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:38.325976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.326927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.327226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.358865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:38.360348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.377713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.378426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.378789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.379096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.379837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.382244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.403907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1148/2286] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:38.409730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.413383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.439947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c333-9125-47e9-8565-15c03ce089cb admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.448610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.450181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.450719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.451388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] PATH_INFO: `/v3/projects/d297918c42164292928e9116057e333c/users/a4505a1d5d2f47f795eb55a1d6bec5d8/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.454608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297918c42164292928e9116057e333c, user_id=a4505a1d5d2f47f795eb55a1d6bec5d8, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.458143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421edeb-ed45-492e-bcf4-2f318824219d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.476455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1149/2287] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:38 2022] PUT /identity/v3/projects/d297918c42164292928e9116057e333c/users/a4505a1d5d2f47f795eb55a1d6bec5d8/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:38.525854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1139/2288] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:38.528260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.528580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.528832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.561772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:38.563181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.670257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.671317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1150/2289] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:38.685466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5ea4-12df-48a7-b3ca-1645e77b18e5 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.696337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.697143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.697611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.697942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.698776 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:38.699204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.705337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a810-f6ea-44e6-af40-4ae6792339b9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.744099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.751878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1140/2290] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:50:38.754043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9dc7c-d056-4302-8b43-85837bac0200 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.762344 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.762988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.763288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.763557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.764204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.784539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.787658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.787943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.788217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.822768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] MFA Rules not processed for user `fe00be41c3c340fa914f8a1e8603928f`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:38.824019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.865195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1151/2291] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:38 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:38.866490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.897995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:38.914082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:38.960248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1141/2292] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:39.010421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30d96c-031d-462d-bbb7-3eb2d5ec86d5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:39.018907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:39.019954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.020387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.020743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.021713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:39.023629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:39.073730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:39.073987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1152/2293] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:38 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:39.111123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3fb6-99bd-4f3d-8554-3cdb34be852d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:39.127666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:39.128767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.129050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.130445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.131703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:39.133115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:39.162077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:39.162326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1142/2294] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:39.189753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9343b-7058-488b-bddb-73e90a1dc0c3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:39.204233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:39.207174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.208010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.209258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.210203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:39.214589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be1a8-45af-41b4-a41c-5b20625475e7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:39.252241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:39.253637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1153/2295] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:39.267596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa0dc-8e25-461c-a9a6-00c01c346c07 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:39.281088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:39.282076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.284004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.284367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] PATH_INFO: `/v3/projects/9786eb2a2c214071bf71e9621ef7fe96/users/bcc7689fdc104c62a657e76650734425/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.316629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9786eb2a2c214071bf71e9621ef7fe96, user_id=bcc7689fdc104c62a657e76650734425, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:39.319702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:39.361899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.362587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.362587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.365644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1143/2296] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:39 2022] PUT /identity/v3/projects/9786eb2a2c214071bf71e9621ef7fe96/users/bcc7689fdc104c62a657e76650734425/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:39.415704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] MFA Rules not processed for user `bcc7689fdc104c62a657e76650734425`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:39.417247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:39.594293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1154/2297] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:39.678254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:39.685974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:39.862564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50134-a67a-40dd-8c21-2c90f1fd6760 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:39.875906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:39.876416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:39.876697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:39.877045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:39.894375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:39.896064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af276-775b-490b-8c6f-f186710284c5 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:39.909610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1144/2298] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:42.202224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:42.204101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:42.367181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e26f5-65d0-4805-b596-56a31e561230 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:42.381448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:42.382346 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:42.382850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:42.383300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] PATH_INFO: `/v3/users/98686737869f4f1885a35f731de6f233` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:42.385227 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98686737869f4f1885a35f731de6f233)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:42.387611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:42.444621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:42.531141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98686737869f4f1885a35f731de6f233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:42.558817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98686737869f4f1885a35f731de6f233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:42.593946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98686737869f4f1885a35f731de6f233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:42.594702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98686737869f4f1885a35f731de6f233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:42.630704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98686737869f4f1885a35f731de6f233'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:42.659370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1155/2299] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:42 2022] DELETE /identity/v3/users/98686737869f4f1885a35f731de6f233 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:42.663688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:42.664210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:42.664210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:42.713250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:42.714715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:42.846125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1145/2300] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:42.859278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:42.861073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:43.072505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e82d-1c62-4875-88ad-7f5c70c4958d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:43.085299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:43.086055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.088458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.100865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:43.123973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:43.125457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:43.153464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1156/2301] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:43.813765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:43.816003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:43.833938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed51a58-6889-43a3-8b6c-26eb3e0c9c4f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:43.841862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:43.843263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.843993 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.844526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] PATH_INFO: `/v3/projects/0cb974150bcd4816a91e38849160f79e` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:43.846524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb974150bcd4816a91e38849160f79e)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:43.849010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:43.939567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:43.942594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb974150bcd4816a91e38849160f79e', 'request_id': 'req-e719948c-eb12-4344-8a91-e9eb40bf9c0c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:43.951164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb974150bcd4816a91e38849160f79e', 'request_id': 'req-e719948c-eb12-4344-8a91-e9eb40bf9c0c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:43.961138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb974150bcd4816a91e38849160f79e', 'request_id': 'req-e719948c-eb12-4344-8a91-e9eb40bf9c0c'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:43.982094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] The token cache is being invalidate because project 0cb974150bcd4816a91e38849160f79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:43.982517 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:43.983995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e719948c-eb12-4344-8a91-e9eb40bf9c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:43.985800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1146/2302] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:43 2022] DELETE /identity/v3/projects/0cb974150bcd4816a91e38849160f79e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:44.967195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:44.968816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:45.012430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b49de-d7ea-4b1a-954b-52bb064b2bdc service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:45.208420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:45.209485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.210162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.211688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] PATH_INFO: `/v3/users/118ffadb18814d3fab3a7f4a20dec43c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.216223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118ffadb18814d3fab3a7f4a20dec43c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:45.220098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:45.327878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:45.331650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118ffadb18814d3fab3a7f4a20dec43c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:45.354060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118ffadb18814d3fab3a7f4a20dec43c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:45.380721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118ffadb18814d3fab3a7f4a20dec43c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:45.381747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118ffadb18814d3fab3a7f4a20dec43c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:45.403546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118ffadb18814d3fab3a7f4a20dec43c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:45.412830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1157/2303] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:44 2022] DELETE /identity/v3/users/118ffadb18814d3fab3a7f4a20dec43c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:45.418074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.419209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.419682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.483808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:45.486639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:45.629295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1147/2304] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:45.642551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:45.644121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:45.757996 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f974eb-a198-4506-99be-d69d36899207 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:45.766320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:45.767076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.767374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.767834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.780310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:45.782090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:45.809318 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1158/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:46.586989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:46.589138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:46.612370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517515-c3f5-4058-8f25-34a969fae535 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:46.634496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:46.641366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:46.641659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:46.643167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] PATH_INFO: `/v3/projects/969be32561494264a08295bf60bfa96d` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:46.647868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969be32561494264a08295bf60bfa96d)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:46.649902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:46.780627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969be32561494264a08295bf60bfa96d', 'request_id': 'req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:46.793063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969be32561494264a08295bf60bfa96d', 'request_id': 'req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:46.805913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969be32561494264a08295bf60bfa96d', 'request_id': 'req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:46.843669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] The token cache is being invalidate because project 969be32561494264a08295bf60bfa96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:46.845164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:46.847350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:46.850939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1148/2306] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:46 2022] DELETE /identity/v3/projects/969be32561494264a08295bf60bfa96d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:46.856041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:46.890123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a33bf7-21fc-404e-94e9-727453c28e98 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.004266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.004992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.005266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.005721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] PATH_INFO: `/v3/users/81b00e9c8a1f42f499bf5a6c345f699a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.007270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b00e9c8a1f42f499bf5a6c345f699a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:47.013124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:47.107392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b00e9c8a1f42f499bf5a6c345f699a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.138457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b00e9c8a1f42f499bf5a6c345f699a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.150701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b00e9c8a1f42f499bf5a6c345f699a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.152253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b00e9c8a1f42f499bf5a6c345f699a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.160763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:47.172023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a5728d6e-963d-4c0b-9ad6-b4896c10ef89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b00e9c8a1f42f499bf5a6c345f699a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.180214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1159/2307] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:46 2022] DELETE /identity/v3/users/81b00e9c8a1f42f499bf5a6c345f699a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:47.505097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:47.506568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.526711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a7a7a-6297-43d3-87ac-fc8d37cb27c1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.612043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.612686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.613166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.613583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] PATH_INFO: `/v3/projects/4bfca50b606b404a933268f353d30d2b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.615667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfca50b606b404a933268f353d30d2b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:47.618345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:47.620519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:47.665240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.665610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.666059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.686642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfca50b606b404a933268f353d30d2b', 'request_id': 'req-c9074f62-a337-42c3-827c-f2c7e3b621c2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.693479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfca50b606b404a933268f353d30d2b', 'request_id': 'req-c9074f62-a337-42c3-827c-f2c7e3b621c2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.699361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfca50b606b404a933268f353d30d2b', 'request_id': 'req-c9074f62-a337-42c3-827c-f2c7e3b621c2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.709839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] MFA Rules not processed for user `a4505a1d5d2f47f795eb55a1d6bec5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:47.711128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.714281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] The token cache is being invalidate because project 4bfca50b606b404a933268f353d30d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:47.714572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.715233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c9074f62-a337-42c3-827c-f2c7e3b621c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:47.716830 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1149/2308] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:47 2022] DELETE /identity/v3/projects/4bfca50b606b404a933268f353d30d2b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:47.722426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02971e-3f2d-45f2-92b2-de06275fa56c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.722890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02971e-3f2d-45f2-92b2-de06275fa56c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.723337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02971e-3f2d-45f2-92b2-de06275fa56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.745110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9f02971e-3f2d-45f2-92b2-de06275fa56c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:47.746416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9f02971e-3f2d-45f2-92b2-de06275fa56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.796627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1160/2309] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:47.809286 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:47.811903 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.819449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1150/2310] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:47.828627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.828897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.829298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.852164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:47.855354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.866831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1151/2311] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:47.871443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:47.881749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4dc4d-c78a-4da0-b940-4573e5ee68f4 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.887553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.888313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.888699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.889044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.889700 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:47.890005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:47.891644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:47.905026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1152/2312] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:50:47.909322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:47.919019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c6f79-610f-4817-90bd-04a70e1c3313 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.923606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.924191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.924471 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.924746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.925402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:47.927357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:47.930506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fe1d1-d3a2-4f53-9296-3b2626b1f2ba None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.934595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.935228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.935501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.935764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.937510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.963737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1153/2313] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:47 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:47.965026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.020186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.021898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.032750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:48.037268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1161/2314] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:48.050343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04c104-8b15-4be6-9d16-7969c9c7f696 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.056823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.057651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.058350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.059044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.059963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.062604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.090502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1154/2315] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:47 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:50:48.097480 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.119624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:48.134379 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558a93-2ecd-42e8-830e-ae501b473e12 service glance] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.143595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.143595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.143595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.143595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.158504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.165010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217822-0451-4a72-9eb2-91b74638f38d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.196883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1162/2316] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:48.202275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.215476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2a6cf-f37f-4834-a42a-f04cad09403b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.244058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdc1e-7a21-4b3b-85c0-8984029ab510 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.244304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdc1e-7a21-4b3b-85c0-8984029ab510 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.244808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abdc1e-7a21-4b3b-85c0-8984029ab510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.247128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.249418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.249709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.249988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.253004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.262795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.275609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-62abdc1e-7a21-4b3b-85c0-8984029ab510 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:48.277626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-62abdc1e-7a21-4b3b-85c0-8984029ab510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:48.297848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1155/2317] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:48.300378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.324563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a950611-527d-4ff2-968a-188ee33df2bc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.333504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.335234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.335727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.336387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] PATH_INFO: `/v3/projects/2e5258bfa2b343479eeb201539335e14/users/ddd9e670dd7f4111a6ba963b6d03cf5b/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.375636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5258bfa2b343479eeb201539335e14, user_id=ddd9e670dd7f4111a6ba963b6d03cf5b, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.379563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.414309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1163/2318] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:50:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:48.418618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1156/2319] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:48 2022] PUT /identity/v3/projects/2e5258bfa2b343479eeb201539335e14/users/ddd9e670dd7f4111a6ba963b6d03cf5b/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:48.447526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.450194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.453817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.526076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] MFA Rules not processed for user `ddd9e670dd7f4111a6ba963b6d03cf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:48.527619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:48.629912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.642374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:48.672499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1164/2320] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:48.675007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.808141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae4a2-1b55-4973-b85f-74cfc3d3609e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.815836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.816651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.817120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.817807 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.819019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:48.821810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:48.827893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fc917-0f76-401d-b1f4-b0718c7802d5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:48.851883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:48.852531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:48.852835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:48.853142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:48.925456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1165/2321] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:48 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:48.926587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:48.984999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:49.067958 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.069652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.083855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1157/2322] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:50:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:50:49.105146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05316-ae7f-4b96-b78c-eb15aff0e147 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.136233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.136233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.136233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.136495 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.138195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.139782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.185969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1166/2323] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:48 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:49.187360 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:49.199006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40376-efaa-401a-91b9-84983b4ddf5e service swift] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.209716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.211595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.211847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.212811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.213687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.216817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.232060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1158/2324] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:49.236998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:49.255952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc91d6f-6dfe-4fba-9715-a354cf64e55b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.262697 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.263641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.264094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.264550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] PATH_INFO: `/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e/users/cb40b8b0ebf648b586b02277462fd0eb/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.284324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60aeea8b69d4e5bb5bd48e75237cf3e, user_id=cb40b8b0ebf648b586b02277462fd0eb, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.287085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.327053 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1167/2325] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:49 2022] PUT /identity/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e/users/cb40b8b0ebf648b586b02277462fd0eb/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:49.328486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:49.345509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cffd-1d5f-48f8-b09d-e9b21e7ad852 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.425591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:49.517181 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.517896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.518248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.518595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.519398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.521328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedb04d-a9cd-42d3-b875-76c1d78ec2b8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.539952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1159/2326] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:49.541656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:49.558970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a65-7141-4e72-9855-0bfe1fc9f205 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.575369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.595691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.595979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.596433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] PATH_INFO: `/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e/users/cb40b8b0ebf648b586b02277462fd0eb/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.603543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60aeea8b69d4e5bb5bd48e75237cf3e, user_id=cb40b8b0ebf648b586b02277462fd0eb, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:49.628933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:49.654911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1168/2327] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:49 2022] PUT /identity/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e/users/cb40b8b0ebf648b586b02277462fd0eb/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:49.665629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.666192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.666284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.734463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] MFA Rules not processed for user `cb40b8b0ebf648b586b02277462fd0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:49.735709 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:49.840720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1160/2328] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:49.854944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:49.857563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:49.983483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e803-b405-42c5-90d1-997fa0793982 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:49.995334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:49.996835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.997369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.998372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:50.225719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:50.228456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737c84c-081c-4d8a-a694-76d01c7e2374 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:50.263999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1169/2329] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:53.438694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:53.591281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4857f-4dac-4e28-a1be-5d08ae5ea0cb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:53.616422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:53.617115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:53.617396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:53.617672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] PATH_INFO: `/v3/users/ddd9e670dd7f4111a6ba963b6d03cf5b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:53.619629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd9e670dd7f4111a6ba963b6d03cf5b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:53.622414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:53.757638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd9e670dd7f4111a6ba963b6d03cf5b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:53.776007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:53.786674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd9e670dd7f4111a6ba963b6d03cf5b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:53.816912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd9e670dd7f4111a6ba963b6d03cf5b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:53.817795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd9e670dd7f4111a6ba963b6d03cf5b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:53.818610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd9e670dd7f4111a6ba963b6d03cf5b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:53.862988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1161/2330] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:53 2022] DELETE /identity/v3/users/ddd9e670dd7f4111a6ba963b6d03cf5b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:53.868528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:53.869135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:53.869135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:53.906767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:53.911629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:53.913254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:53.914043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:53.953010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:54.092234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75717c68-a8b6-40f9-890e-e49c4f20bb92 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:54.097686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:54.098557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:54.099126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:54.099919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] PATH_INFO: `/v3/users/bcc7689fdc104c62a657e76650734425` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:54.101535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc7689fdc104c62a657e76650734425)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:54.104995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:54.117025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1170/2331] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:54.123661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:54.126069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:54.200542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc7689fdc104c62a657e76650734425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:54.217350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc7689fdc104c62a657e76650734425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:54.226376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc7689fdc104c62a657e76650734425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:54.227445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc7689fdc104c62a657e76650734425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:54.228407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-88210f8c-8ca6-48ba-af75-3156216ffe04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc7689fdc104c62a657e76650734425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:54.261871 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1162/2332] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:53 2022] DELETE /identity/v3/users/bcc7689fdc104c62a657e76650734425 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:54.267110 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:54.267460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:54.267934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:54.269501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2b433-da7d-439c-99d8-20a911c17212 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:54.338641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:54.338641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:54.471157 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:54.473341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:54.473626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:54.473904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:54.476840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:54.485378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:54.507829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1163/2333] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:54.539914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:54.541777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:54.543014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:54.549845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:54.574412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1171/2334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:54.577763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8407-7fc6-44b3-9048-70a6e7227220 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:54.586790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:54.587430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:54.587713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:54.587987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:54.625943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:54.627420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:54.654024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1164/2335] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:55.135783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:55.137814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.158543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fcea0-84a5-4acd-9e7f-6d1655a3e80c service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:55.183153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:55.183940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.184337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.184626 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] PATH_INFO: `/v3/projects/2e5258bfa2b343479eeb201539335e14` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.191316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5258bfa2b343479eeb201539335e14)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:55.193306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:55.203864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:55.206377 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.249248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611956cb-77b7-4820-8c2d-f89e14f29256 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:55.257945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:55.258874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.259317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.259743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] PATH_INFO: `/v3/projects/9786eb2a2c214071bf71e9621ef7fe96` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.261095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9786eb2a2c214071bf71e9621ef7fe96)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:55.272994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:55.294989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5258bfa2b343479eeb201539335e14', 'request_id': 'req-7594501e-d275-4675-9ac4-6974f0523a93'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.300844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5258bfa2b343479eeb201539335e14', 'request_id': 'req-7594501e-d275-4675-9ac4-6974f0523a93'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.311324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5258bfa2b343479eeb201539335e14', 'request_id': 'req-7594501e-d275-4675-9ac4-6974f0523a93'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.325630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] The token cache is being invalidate because project 2e5258bfa2b343479eeb201539335e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:55.325916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.326665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.330331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1172/2336] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:55 2022] DELETE /identity/v3/projects/2e5258bfa2b343479eeb201539335e14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:55.334433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:55.335850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.341537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:55.347789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9786eb2a2c214071bf71e9621ef7fe96', 'request_id': 'req-4e446a56-c890-46e8-a4e7-a60036aee9ce'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.358425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9786eb2a2c214071bf71e9621ef7fe96', 'request_id': 'req-4e446a56-c890-46e8-a4e7-a60036aee9ce'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.372759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9786eb2a2c214071bf71e9621ef7fe96', 'request_id': 'req-4e446a56-c890-46e8-a4e7-a60036aee9ce'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.391939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] The token cache is being invalidate because project 9786eb2a2c214071bf71e9621ef7fe96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:55.392654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.393722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4e446a56-c890-46e8-a4e7-a60036aee9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.396051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1165/2337] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:55 2022] DELETE /identity/v3/projects/9786eb2a2c214071bf71e9621ef7fe96 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:55.400658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff10d9-6392-4dee-b7a9-93207b3e5749 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.401249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff10d9-6392-4dee-b7a9-93207b3e5749 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.401767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff10d9-6392-4dee-b7a9-93207b3e5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.424628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594501e-d275-4675-9ac4-6974f0523a93 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:55.452656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c5ff10d9-6392-4dee-b7a9-93207b3e5749 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:55.453939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c5ff10d9-6392-4dee-b7a9-93207b3e5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.506275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:55.508373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.508726 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.510079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] PATH_INFO: `/v3/users/cb40b8b0ebf648b586b02277462fd0eb` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.512376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb40b8b0ebf648b586b02277462fd0eb)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:55.517281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:55.571258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1166/2338] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:55.575991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.576284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.576695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.607229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:55.609642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.627439 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1167/2339] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:55.632087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:55.642421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191992-39fc-437e-8979-c3a0a067f0ab None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:55.643873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb40b8b0ebf648b586b02277462fd0eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.647807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:55.648656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:55.648939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:55.649256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:55.649909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:55.650205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:55.651853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:55.665635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb40b8b0ebf648b586b02277462fd0eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.685043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb40b8b0ebf648b586b02277462fd0eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.685286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1168/2340] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:55.686559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb40b8b0ebf648b586b02277462fd0eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.688907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:55.695549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:55.714510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb40b8b0ebf648b586b02277462fd0eb'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:55.724387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1173/2341] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:50:55 2022] DELETE /identity/v3/users/cb40b8b0ebf648b586b02277462fd0eb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:55.746971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6bfc-3d83-4883-84e4-4150e4e52be8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:55.943822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:56.004533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.005659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.005940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.006396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.007177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.009658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.087636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1169/2342] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:56.089708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.104387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64f7d-ce40-4833-8a95-94e61d72d370 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.169253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:56.254922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.255663 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.256042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.256416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.257523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.259671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.297756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1174/2343] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:56.301418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.315950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b46f4-de03-4e85-af48-42a4ff993c02 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.337965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.339991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.341840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.341984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.345561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.347910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.350756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.352769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:56.374749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6940-44ff-42ef-83d7-d8312b82fc11 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.384505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1170/2344] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:56.385015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.385881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.386083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.386488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.386939 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] PATH_INFO: `/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.388567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60aeea8b69d4e5bb5bd48e75237cf3e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.391617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.403300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6dd2f-2727-4f65-8b55-0adf6a6fc99e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.417730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.418721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.419005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.419281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.420549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.424281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.452135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1171/2345] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:56.455011 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.475666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba081f0-efce-40a1-b429-4522cae5b503 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.482185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.482963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.483350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.483732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] PATH_INFO: `/v3/projects/c3b8473651084d58be78811b7bf254e1/users/9bb4111f2adb44d9a9353ce84618e938/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.523522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b8473651084d58be78811b7bf254e1, user_id=9bb4111f2adb44d9a9353ce84618e938, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.529894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0037e3-6297-4a91-ad5e-f1d2f029c81b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.532688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60aeea8b69d4e5bb5bd48e75237cf3e', 'request_id': 'req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:56.541279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60aeea8b69d4e5bb5bd48e75237cf3e', 'request_id': 'req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:56.552676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1172/2346] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:56 2022] PUT /identity/v3/projects/c3b8473651084d58be78811b7bf254e1/users/9bb4111f2adb44d9a9353ce84618e938/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:56.566615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60aeea8b69d4e5bb5bd48e75237cf3e', 'request_id': 'req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:56.569155 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.569531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.569810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.583324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] The token cache is being invalidate because project c60aeea8b69d4e5bb5bd48e75237cf3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:50:56.583741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:56.584326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-05c59ad1-6a3a-44b6-9ee3-ea6f92b61983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:50:56.586428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1175/2347] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:50:56 2022] DELETE /identity/v3/projects/c60aeea8b69d4e5bb5bd48e75237cf3e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:56.591904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b561-139b-4df1-a845-377533cfc1cb None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.592314 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b561-139b-4df1-a845-377533cfc1cb None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.592956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b561-139b-4df1-a845-377533cfc1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.625925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] MFA Rules not processed for user `9bb4111f2adb44d9a9353ce84618e938`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:56.630255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:56.633844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d4d7b561-139b-4df1-a845-377533cfc1cb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:56.636169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d4d7b561-139b-4df1-a845-377533cfc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:56.759693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1173/2348] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:56.761452 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1176/2349] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:56.762270 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.770143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:56.773237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.774968 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.779320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.813412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fa07d-4520-4d65-8776-2a1a47f6bd44 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.819682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:56.821113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:56.823214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.827391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.827704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.827983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.828796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.831305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.835812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1177/2350] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:56.840075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.850831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d531b-3b61-45df-bb2b-7188197e007a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.858116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:56.859186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:56.860111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:56.860532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:56.861716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:50:56.862283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:56.864455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:56.872794 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1174/2351] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:56.876779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.888686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1178/2352] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:50:56.889594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:56.905076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786856d-a618-42ab-a813-71a6380ce18e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:56.933886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:56.985848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:57.001170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d08b5-1fbc-47ad-b770-df027a0d32f3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.009525 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.010231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.010574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.010911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.011624 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.013710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.017218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.018099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.018581 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.019038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.020066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.023601 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.054499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1175/2353] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:57.058264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.071912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1179/2354] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:56 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:57.074017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfb4aa-2a28-469a-a98c-e14730d32179 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.076465 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.175998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f48b-c608-4af7-8946-c3b91c6fee96 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.183837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.184886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.185299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.185683 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.186439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.188935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.189468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.190036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.190473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.190885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.191707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.193492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.209902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1176/2355] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:57.211217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.219685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1180/2356] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:57 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:57.222900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4075f9-0164-4cfa-ba90-4f0cb47e22d6 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.223975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.228103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.228935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.229431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.230171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.234256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.235742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.248118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d8a7-bf32-48d0-8511-a0f70c076db6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.260363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1177/2357] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:57.265743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.266612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.267063 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.267315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.267488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.268125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.269772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.283145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1181/2358] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:57.288059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.297204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6686f1-39f4-45c7-9530-046558c0f094 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.303661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a1cc-16c2-4365-829a-acfd362e55fd admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.308868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.309419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.309620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.310228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.310508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.310676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.310783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] PATH_INFO: `/v3/projects/8b9e8cbd1397472ba3b008d142071f70/users/7eb59f91f40f45c49f081962f5a6c262/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.311173 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.311995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.314058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.328916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1182/2359] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:50:57.333616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.343166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9e8cbd1397472ba3b008d142071f70, user_id=7eb59f91f40f45c49f081962f5a6c262, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.346175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320203-0582-451e-97f2-6457edd373c4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.355242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1d50-4b1f-4a80-9aa9-99da12d800f8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.367195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.368369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.368935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.369456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] PATH_INFO: `/v3/projects/fffff978c3e641e585af7092f0d5b28c/users/2b55c9b70929464b956c38a11b500ce5/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.390949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffff978c3e641e585af7092f0d5b28c, user_id=2b55c9b70929464b956c38a11b500ce5, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.403448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1b28-04a2-439c-9f0d-cdc2acd7cee9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.418662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1178/2360] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:57 2022] PUT /identity/v3/projects/8b9e8cbd1397472ba3b008d142071f70/users/7eb59f91f40f45c49f081962f5a6c262/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:57.430890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.431213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.431406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.457396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1183/2361] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:57 2022] PUT /identity/v3/projects/fffff978c3e641e585af7092f0d5b28c/users/2b55c9b70929464b956c38a11b500ce5/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:57.460266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.460557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.460831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.543626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] MFA Rules not processed for user `7eb59f91f40f45c49f081962f5a6c262`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:57.548191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:57.560105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] MFA Rules not processed for user `2b55c9b70929464b956c38a11b500ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:57.561715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:57.640949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:57.654127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1179/2362] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:57.658688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.696359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1184/2363] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:57.703704 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.706631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:57.708482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:57.756028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a9e7b-a1f9-475c-8950-4b7f89754cfc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.760980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.761629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.761987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.762264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.762911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.764911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.813762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1180/2364] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:50:57 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:57.814685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.815822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405db776-6d7e-4a83-857b-f2c7cf5f8855 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.904014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a55f3-971c-4f68-beb2-d10ed91a79bf admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.909321 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.910789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.912277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.912587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.913250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.915365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:57.952666 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1181/2365] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:50:57 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:50:57.955134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.955935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:57.956255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.956600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.956937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.979372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f232a5-ad62-41fe-a395-5c0676f0a646 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:57.989505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:57.990368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:57.990816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:57.991397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:57.992572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:57.994374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.012822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1182/2366] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:58.013523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:58.025533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9968-26d7-4d23-be19-0431dc32c2ba admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:58.033087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:58.033852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:58.034189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:58.034561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] PATH_INFO: `/v3/projects/b359b8893faf403aaff09dac0fb8270b/users/1bacd8e1df6142cc8aa84a68ae9c6573/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:58.065068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b359b8893faf403aaff09dac0fb8270b, user_id=1bacd8e1df6142cc8aa84a68ae9c6573, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:58.068750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.099547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1183/2367] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:58 2022] PUT /identity/v3/projects/b359b8893faf403aaff09dac0fb8270b/users/1bacd8e1df6142cc8aa84a68ae9c6573/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:50:58.100836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:58.134321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:58.135798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.161789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1185/2368] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:58.205054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efce9b-9e58-467a-8383-7b0c2acd87f3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:58.222341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:58.225355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:58.225679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:58.225964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:58.230633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:58.232402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1f1b1-96d7-489c-abd8-177ca8c37aaa admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.249017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1184/2369] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:50:58.253370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:58.270432 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f857fa-b112-4a1d-8bda-8b41883ae75d service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:58.282579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:58.283298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:58.283622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:58.283899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] PATH_INFO: `/v3/projects/b359b8893faf403aaff09dac0fb8270b/users/1bacd8e1df6142cc8aa84a68ae9c6573/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:58.288611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b359b8893faf403aaff09dac0fb8270b, user_id=1bacd8e1df6142cc8aa84a68ae9c6573, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:58.291703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.313022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1186/2370] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:50:58 2022] PUT /identity/v3/projects/b359b8893faf403aaff09dac0fb8270b/users/1bacd8e1df6142cc8aa84a68ae9c6573/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:50:58.322085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263700a7-66de-415b-969a-915744e1e01c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:58.322582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263700a7-66de-415b-969a-915744e1e01c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:58.322954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263700a7-66de-415b-969a-915744e1e01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:58.344726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:58.378278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-263700a7-66de-415b-969a-915744e1e01c None None] MFA Rules not processed for user `1bacd8e1df6142cc8aa84a68ae9c6573`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:58.379981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-263700a7-66de-415b-969a-915744e1e01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:58.501982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1185/2371] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:50:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:58.511164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:58.513232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:58.574768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:58.604193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a470c-9152-43c7-b654-4bf76f9bf1d7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:58.609909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:58.610690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:58.611151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:58.611520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:58.685456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:58.687108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572bbd-ec03-44bc-9099-d8b42a3d9b1e service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:58.698790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1187/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:59.451006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:59.451545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:59.451671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:59.453865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1186/2373] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:59.775757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:59.776323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:59.776323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:59.806092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:59.807364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:00.006227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:00.014840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:00.024126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1188/2374] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:50:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:00.067239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:00.070536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:00.112378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fd792-836a-45a7-ba15-5cc23fc3c38d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:00.134632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:00.135263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:00.135537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:00.135805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:00.154858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:00.156471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:00.169679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97db76-1b6a-4c93-8c51-905915ba824d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:00.177049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:00.178036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:00.178529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:00.179057 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] PATH_INFO: `/v3/users/9f85648dc6f049acb0c6912485298190` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:00.193211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f85648dc6f049acb0c6912485298190)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:00.193211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:00.193399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1189/2375] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:51:00.283021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f85648dc6f049acb0c6912485298190'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:00.301183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f85648dc6f049acb0c6912485298190'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:00.324364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f85648dc6f049acb0c6912485298190'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:00.325374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f85648dc6f049acb0c6912485298190'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:00.330913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f85648dc6f049acb0c6912485298190'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:00.364947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1187/2376] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:00 2022] DELETE /identity/v3/users/9f85648dc6f049acb0c6912485298190 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:00.607237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:00.617923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44509-6572-4a56-86f7-b779b8417577 service placement] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:00.688135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:00.688761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:00.689073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:00.689345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:00.691357 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:00.759210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:00.828419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:00.830368 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:00.877751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1190/2377] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:00.929248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:00.931207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:00.975317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:01.126690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd61b0c-c14b-4e93-8b04-69bc113a5bb8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:01.134667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:01.136074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:01.136404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:01.136918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] PATH_INFO: `/v3/projects/04b48b5c96684a089e79697990c8c51e` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:01.140559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b48b5c96684a089e79697990c8c51e)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:01.145532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:01.226612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b48b5c96684a089e79697990c8c51e', 'request_id': 'req-17f8fd65-1726-428b-a5c1-999b6b9b1256'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.234918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b48b5c96684a089e79697990c8c51e', 'request_id': 'req-17f8fd65-1726-428b-a5c1-999b6b9b1256'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.240894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b48b5c96684a089e79697990c8c51e', 'request_id': 'req-17f8fd65-1726-428b-a5c1-999b6b9b1256'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.263257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] The token cache is being invalidate because project 04b48b5c96684a089e79697990c8c51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:01.263823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.264846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.269133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1188/2378] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:00 2022] DELETE /identity/v3/projects/04b48b5c96684a089e79697990c8c51e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:01.272979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:01.286433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e771-3cc4-4141-9b1d-b44a15f8b3c1 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:01.388288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:01.389124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:01.389405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:01.389678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] PATH_INFO: `/v3/users/4ad792a37a364e429dc9303f0fa28869` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:01.390826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad792a37a364e429dc9303f0fa28869)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:01.392764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:01.461000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad792a37a364e429dc9303f0fa28869'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.470251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad792a37a364e429dc9303f0fa28869'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.479372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad792a37a364e429dc9303f0fa28869'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.480110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad792a37a364e429dc9303f0fa28869'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.496189 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad792a37a364e429dc9303f0fa28869'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:01.505658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1191/2379] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:01 2022] DELETE /identity/v3/users/4ad792a37a364e429dc9303f0fa28869 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:01.759682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:01.761781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:01.789136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8fd65-1726-428b-a5c1-999b6b9b1256 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:01.844206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:01.845802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:01.919483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:01.924805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d08fe-2f70-4d78-92ae-ce50b0e4631d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:01.931181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:01.932011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:01.932610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:01.933649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:01.936238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:01.958048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:01.959844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:01.960339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:01.960759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] PATH_INFO: `/v3/projects/f9395a856ada406ab1a9e9699b88b08d` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:01.962133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9395a856ada406ab1a9e9699b88b08d)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:01.964299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.050646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:02.065407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9395a856ada406ab1a9e9699b88b08d', 'request_id': 'req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:02.087819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9395a856ada406ab1a9e9699b88b08d', 'request_id': 'req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:02.099745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.102763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9395a856ada406ab1a9e9699b88b08d', 'request_id': 'req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:02.104769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a4e77-1d21-4ad9-854a-7c6532154dc7 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.131189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] The token cache is being invalidate because project f9395a856ada406ab1a9e9699b88b08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:02.131661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:02.142732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e05f03e7-6dd1-4bed-861f-7cf9f6f92acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:02.144593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1192/2380] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:51:02.148650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1189/2381] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:01 2022] DELETE /identity/v3/projects/f9395a856ada406ab1a9e9699b88b08d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:02.154133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb883-edce-4973-ac1e-e541aa04aa90 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.154564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb883-edce-4973-ac1e-e541aa04aa90 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.154932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb883-edce-4973-ac1e-e541aa04aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.184511 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-72ddb883-edce-4973-ac1e-e541aa04aa90 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:02.185474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-72ddb883-edce-4973-ac1e-e541aa04aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:02.304725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.305264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.305704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.332814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1193/2382] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:02.333014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] MFA Rules not processed for user `fe00be41c3c340fa914f8a1e8603928f`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:02.334490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:02.343159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.345861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.347638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.384295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:02.385537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:02.400406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1194/2383] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:02.401611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.413134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aafbd2-6d7b-429e-9b8b-e4c5799cb745 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.419478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.420061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.420197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1190/2384] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:02.420360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.420631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.421317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:51:02.421621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.423291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.437023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1195/2385] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:51:02.448208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.470406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f7f41-723d-4c98-a924-120816e18511 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.476152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.476862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.477259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.477576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.478542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.481290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.544948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1191/2386] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:02.551624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.566538 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b096-aaf7-4acb-8e5a-a6665be98d5d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.647288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.648208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.648483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.648750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.649441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.651679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.685033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1196/2387] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:02.689509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.701924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e870b-364e-4d7c-818e-b9c4fb4dc4d4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.707748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.708442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.708810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.709183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.710012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.711931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.726333 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1192/2388] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:51:02.727890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.745032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ece7-5d50-478b-8a62-97e28f937c82 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.758406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.759044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.759326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.759600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.760255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.762086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e71e61-ec86-4cc7-a6c7-6ee3b8e6afe4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.766109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:02.782279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1197/2389] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:02.786482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:02.798565 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3b00-580b-4eba-972d-d9e2fb645d76 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:02.804005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:02.804948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.805419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.805793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] PATH_INFO: `/v3/projects/f367595b248f431a94160f8bad67e3bb/users/5d1119a6753c466496ff8d971e506276/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.826521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f367595b248f431a94160f8bad67e3bb, user_id=5d1119a6753c466496ff8d971e506276, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:02.829529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:02.860297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1193/2390] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:02 2022] PUT /identity/v3/projects/f367595b248f431a94160f8bad67e3bb/users/5d1119a6753c466496ff8d971e506276/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:51:02.862310 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941342b-b11e-4431-b637-93cb3d6c1d93 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:02.862800 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941342b-b11e-4431-b637-93cb3d6c1d93 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:02.863096 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941342b-b11e-4431-b637-93cb3d6c1d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:02.913195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8941342b-b11e-4431-b637-93cb3d6c1d93 None None] MFA Rules not processed for user `5d1119a6753c466496ff8d971e506276`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:02.914509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8941342b-b11e-4431-b637-93cb3d6c1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:02.995745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1198/2391] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:03.014617 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:03.017649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:03.155487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091c78-8c26-41d1-8eb7-cd0668d57260 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:03.164404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:03.174306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:03.174653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:03.174946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:03.185212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:03.187114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:03.204163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1194/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:04.670308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda606d0-f897-480b-b647-455a0215c5f4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:04.671135 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda606d0-f897-480b-b647-455a0215c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:04.671295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda606d0-f897-480b-b647-455a0215c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:04.691713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fda606d0-f897-480b-b647-455a0215c5f4 None None] MFA Rules not processed for user `403abcd329c845089083a84cc877ec41`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:04.692927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fda606d0-f897-480b-b647-455a0215c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:04.751285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1199/2393] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:07.013325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:07.015452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:07.081369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:07.146426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172dd3-4864-43ea-9e05-5d0306292f6e service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:07.152801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:07.153892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:07.154297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:07.154886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] PATH_INFO: `/v3/users/9bb4111f2adb44d9a9353ce84618e938` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:07.156237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb4111f2adb44d9a9353ce84618e938)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:07.158235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:07.216822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb4111f2adb44d9a9353ce84618e938'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.233943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb4111f2adb44d9a9353ce84618e938'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.242636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb4111f2adb44d9a9353ce84618e938'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.243541 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb4111f2adb44d9a9353ce84618e938'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.244283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb4111f2adb44d9a9353ce84618e938'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.270603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1195/2394] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:07 2022] DELETE /identity/v3/users/9bb4111f2adb44d9a9353ce84618e938 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:07.275484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:07.275986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:07.276082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:07.298900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:07.300372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:07.360695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1200/2395] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:07.371121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:07.372716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:07.452128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ceb8c-81f2-4e28-ac12-1ef71ca0249a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:07.456647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:07.457309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:07.457604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:07.457877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:07.468138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:07.469634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:07.479213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1196/2396] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:07.759224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:07.760695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:07.773445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5638e-b925-4546-9b79-d75c016e1cf8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:07.779175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:07.779834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:07.780232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:07.780505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] PATH_INFO: `/v3/projects/c3b8473651084d58be78811b7bf254e1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:07.781753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b8473651084d58be78811b7bf254e1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:07.783772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:07.818276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:07.845574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b8473651084d58be78811b7bf254e1', 'request_id': 'req-10209203-0047-4ff3-9fc1-499565984d7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.859616 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b8473651084d58be78811b7bf254e1', 'request_id': 'req-10209203-0047-4ff3-9fc1-499565984d7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.874047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b8473651084d58be78811b7bf254e1', 'request_id': 'req-10209203-0047-4ff3-9fc1-499565984d7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.888237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] The token cache is being invalidate because project c3b8473651084d58be78811b7bf254e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:07.888813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.889647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-10209203-0047-4ff3-9fc1-499565984d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:07.897257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1201/2397] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:07 2022] DELETE /identity/v3/projects/c3b8473651084d58be78811b7bf254e1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:07.898570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:07.910108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afadd5e-ca90-417d-9099-26d4d1763b84 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:07.974556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:07.996801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:07.997573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:07.998077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:07.998444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] PATH_INFO: `/v3/users/7eb59f91f40f45c49f081962f5a6c262` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:07.999705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb59f91f40f45c49f081962f5a6c262)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:08.001823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:08.078116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb59f91f40f45c49f081962f5a6c262'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:08.108997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb59f91f40f45c49f081962f5a6c262'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:08.133647 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb59f91f40f45c49f081962f5a6c262'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:08.134521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb59f91f40f45c49f081962f5a6c262'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:08.135226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb59f91f40f45c49f081962f5a6c262'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:08.154406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1197/2398] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:07 2022] DELETE /identity/v3/users/7eb59f91f40f45c49f081962f5a6c262 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:08.276855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.277888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.278615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.305458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:08.307681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:08.453469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1202/2399] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:08.468281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:08.470108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:08.655834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178fce-6ca1-4b61-a2c8-96d66bf654e9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:08.665844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:08.666490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.666813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.667045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.697733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:08.705509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:08.705852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:08.712907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:08.725639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1198/2400] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:51:08.891766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef9be-e017-406d-b22f-811a6795be37 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:08.918604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:08.919517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.919956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.920414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] PATH_INFO: `/v3/projects/8b9e8cbd1397472ba3b008d142071f70` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.927366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9e8cbd1397472ba3b008d142071f70)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:08.929446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:09.070146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9e8cbd1397472ba3b008d142071f70', 'request_id': 'req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.078182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9e8cbd1397472ba3b008d142071f70', 'request_id': 'req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.088403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:09.097958 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9e8cbd1397472ba3b008d142071f70', 'request_id': 'req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.138451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] The token cache is being invalidate because project 8b9e8cbd1397472ba3b008d142071f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:09.138971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.139850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.142961 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1203/2401] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:08 2022] DELETE /identity/v3/projects/8b9e8cbd1397472ba3b008d142071f70 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:09.147147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:09.170188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599157e-ac05-486c-b6da-a9b9321be23f service swift] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:09.309344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:09.351691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:09.352730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:09.353902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:09.355555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] PATH_INFO: `/v3/users/1bacd8e1df6142cc8aa84a68ae9c6573` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:09.357584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bacd8e1df6142cc8aa84a68ae9c6573)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:09.360905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:09.480891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bacd8e1df6142cc8aa84a68ae9c6573'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.516903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bacd8e1df6142cc8aa84a68ae9c6573'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.528651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bacd8e1df6142cc8aa84a68ae9c6573'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.529927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bacd8e1df6142cc8aa84a68ae9c6573'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.531327 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bbae35a3-c053-416f-b773-d8740b03e663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bacd8e1df6142cc8aa84a68ae9c6573'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.580787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1199/2402] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:09 2022] DELETE /identity/v3/users/1bacd8e1df6142cc8aa84a68ae9c6573 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:09.605499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:09.607895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:09.632578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ef6e-fc3c-4aa7-bf9f-6397d60f29c6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:09.766575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:09.767796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:09.768186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:09.768471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] PATH_INFO: `/v3/users/5d1119a6753c466496ff8d971e506276` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:09.771111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1119a6753c466496ff8d971e506276)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:09.775107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:09.890095 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1119a6753c466496ff8d971e506276'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.900787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1119a6753c466496ff8d971e506276'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.911101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1119a6753c466496ff8d971e506276'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.911101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1119a6753c466496ff8d971e506276'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.956378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1119a6753c466496ff8d971e506276'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:09.971101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1204/2403] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:09 2022] DELETE /identity/v3/users/5d1119a6753c466496ff8d971e506276 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:09.976689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:09.976893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:09.978145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.020516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:10.023380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:10.207242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:10.209573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:10.233477 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1200/2404] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:10.271281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:10.273234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:10.387287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f94f32-2b7a-405c-ade9-654efd2e1bc1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:10.398599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:10.399520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:10.399821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:10.400134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] PATH_INFO: `/v3/projects/b359b8893faf403aaff09dac0fb8270b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.401645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b359b8893faf403aaff09dac0fb8270b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:10.409183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:10.455390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:10.472410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62bd46-797c-4760-88b4-7eb6aab25d82 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:10.490189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:10.490189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:10.490189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:10.490189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.531121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:10.536140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72ed42-58ae-4b15-8017-1f591c1d72fd service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:10.574539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b359b8893faf403aaff09dac0fb8270b', 'request_id': 'req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:10.574750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1201/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:51:10.587879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b359b8893faf403aaff09dac0fb8270b', 'request_id': 'req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:10.606206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b359b8893faf403aaff09dac0fb8270b', 'request_id': 'req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:10.639787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] The token cache is being invalidate because project b359b8893faf403aaff09dac0fb8270b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:10.640165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:10.645783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-afd9f7e4-ecd6-4e9c-bdc4-6c0c1f2817f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:10.649824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1205/2406] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:10 2022] DELETE /identity/v3/projects/b359b8893faf403aaff09dac0fb8270b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:51:10.655859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:10.656573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:10.657176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.689161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:10.691009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:10.713734 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:10.885638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1202/2407] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:10.893167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:10.893381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:10.893661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.929450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:10.930727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:10.942944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1206/2408] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:10.946575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:10.963773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cbb7a-45f9-49a9-9b7c-04e3ac51b948 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:10.974710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:10.975621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:10.976056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:10.976509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:10.977352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:51:10.977825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:10.979741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.000901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1203/2409] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:51:11.005094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.042249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b304329-10f3-4482-ac03-8e538b822d7c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.067133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.068705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.068705 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.069207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.071212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.081351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.164356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1207/2410] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:11 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:11.168719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.193726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1963ba2-6767-45f1-8173-2ef9e7c86731 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.287266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.287981 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.288157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.288434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.289137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.291211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.335556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.337352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1204/2411] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:11 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:11.372322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd17dc4-a385-408c-8028-1b93e0e974f3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.385941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.386789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.387380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.387827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.389207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.402760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.445935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1208/2412] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:51:11.449394 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.463279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321133e-880b-4e2b-9987-b2c6efb7e251 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.477201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.478114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.478114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.478518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.479165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.484246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac456c-ab28-4c77-9726-3b39019b1fbf admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.515111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1205/2413] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:11.519375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.536931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0af90c-20d1-4819-87d6-a3cd29b12059 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.549858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.550605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.550885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.551160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] PATH_INFO: `/v3/projects/7a66a5e6a3224c46b00f6c3518260684/users/d0d69c5d4e5b4475b0b2946502ef51e0/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.585965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a66a5e6a3224c46b00f6c3518260684, user_id=d0d69c5d4e5b4475b0b2946502ef51e0, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.588713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.647772 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1209/2414] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:11 2022] PUT /identity/v3/projects/7a66a5e6a3224c46b00f6c3518260684/users/d0d69c5d4e5b4475b0b2946502ef51e0/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:11.652865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.653142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.653523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.714653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:11.717478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.731093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.735569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.866229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1206/2415] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:11.884683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.887739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.951141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac532-b6a9-457a-8472-bc8edc380f43 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.963174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.963971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.964265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.964874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] PATH_INFO: `/v3/projects/f367595b248f431a94160f8bad67e3bb` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.966362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f367595b248f431a94160f8bad67e3bb)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.968320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.970378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:12.051681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafa69-9b2f-4b97-b1b0-87ecac4045f9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:12.055615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:12.056240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.056520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.056796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.075734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:12.078058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:12.079535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc7f6-a678-438a-9232-fab40aafe82f service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:12.097684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f367595b248f431a94160f8bad67e3bb', 'request_id': 'req-8ec75301-babf-4a71-a33d-c51f18b40b97'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:12.102231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1207/2416] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:12.113648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f367595b248f431a94160f8bad67e3bb', 'request_id': 'req-8ec75301-babf-4a71-a33d-c51f18b40b97'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:12.129881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f367595b248f431a94160f8bad67e3bb', 'request_id': 'req-8ec75301-babf-4a71-a33d-c51f18b40b97'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:12.166982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] The token cache is being invalidate because project f367595b248f431a94160f8bad67e3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:12.167712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:12.168661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8ec75301-babf-4a71-a33d-c51f18b40b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:12.174326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1210/2417] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:11 2022] DELETE /identity/v3/projects/f367595b248f431a94160f8bad67e3bb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:51:12.179491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.179863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.180595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.243029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:12.244702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:12.385060 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1208/2418] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:12.394998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.395303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.395594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.477790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:12.479073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:12.509388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1211/2419] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:12.514401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:12.538311 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95eb0d-588c-47c7-b373-6c2a8ac52037 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:12.547295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:12.548526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.548917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.549329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.550248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:51:12.550665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:12.552886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:12.571872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1209/2420] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:51:12.576576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:12.599675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafcf9-ff14-4315-a70f-1ad439c6e195 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:12.619205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:12.619851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.620486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.621331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.622259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:12.624508 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:12.727621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1212/2421] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:12 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:12.732451 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:12.756474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6e4e-1390-4287-83e2-54cec9fb7f04 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:12.941540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:12.943986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.944702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.945275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.947274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:12.949795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:12.996104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1210/2422] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:12 2022] POST /identity/v3/users => generated 281 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:12.997952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.018650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37a8a-9c2e-45d3-aeae-fd3b1918475b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.028742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.034031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.034571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.035109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.035953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.037737 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.113014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1213/2423] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:13.117031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.143556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a3e08-890a-4863-9f88-ffd8446dfbac admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.155041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.155841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.156211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.156578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.157730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.160553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a789f8a-c239-4c40-8337-5f90501bdef2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.180711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.181455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1211/2424] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:13.195753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a180-adff-4a06-bca1-2f5f29969982 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.202586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.205422 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.205841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.206218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] PATH_INFO: `/v3/projects/a2e26bedb1db4c6c8597e4c8aba9a3ae/users/1005238acc1f45b1a409b26311d6c7ef/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.232181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e26bedb1db4c6c8597e4c8aba9a3ae, user_id=1005238acc1f45b1a409b26311d6c7ef, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.235444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.271141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1214/2425] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:13 2022] PUT /identity/v3/projects/a2e26bedb1db4c6c8597e4c8aba9a3ae/users/1005238acc1f45b1a409b26311d6c7ef/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:13.282489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.283094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.283457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.335221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] MFA Rules not processed for user `1005238acc1f45b1a409b26311d6c7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:13.336643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:13.418805 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:13.612839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1212/2426] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:13.657474 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.659442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:13.755353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f441d-e34f-4486-8ac4-26a6f2842090 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.759655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.760345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.760625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.760895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.770795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.772237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60064cf-3906-4bed-b8f8-f6ffca0135da service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.782722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1215/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:13.798101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.881302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930ab60-904c-4904-a39d-b9d3e851fd12 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.889067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.890024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.890285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.890667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] PATH_INFO: `/v3/users/1005238acc1f45b1a409b26311d6c7ef` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.892095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1005238acc1f45b1a409b26311d6c7ef)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.894443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.975250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1005238acc1f45b1a409b26311d6c7ef'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:13.993973 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1005238acc1f45b1a409b26311d6c7ef'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:14.004186 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1005238acc1f45b1a409b26311d6c7ef'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:14.005232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1005238acc1f45b1a409b26311d6c7ef'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:14.006350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1005238acc1f45b1a409b26311d6c7ef'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:14.034793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1213/2428] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:13 2022] DELETE /identity/v3/users/1005238acc1f45b1a409b26311d6c7ef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:14.039116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:14.039413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:14.039692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:14.065133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:14.066896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:14.198181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1216/2429] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:14.210105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:14.211996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:14.344744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:14.398197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571fd7a-1804-472f-b262-0aa464ea2dc9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:14.411049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:14.414215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:14.414791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:14.415298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:14.433746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:14.437687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04f603-b726-4ccc-a453-60bf4f73a1bb service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:14.474053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1214/2430] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:15.798889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:15.800446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:15.815194 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f154d-3e3e-4590-b520-58a361320e1e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:15.825126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:15.825922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:15.826186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:15.826458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] PATH_INFO: `/v3/projects/a2e26bedb1db4c6c8597e4c8aba9a3ae` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:15.827746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e26bedb1db4c6c8597e4c8aba9a3ae)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:15.835478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:15.838448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:15.911635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e26bedb1db4c6c8597e4c8aba9a3ae', 'request_id': 'req-a671cfd9-4196-42bc-9092-eecd158a350c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:15.917605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e26bedb1db4c6c8597e4c8aba9a3ae', 'request_id': 'req-a671cfd9-4196-42bc-9092-eecd158a350c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:15.935714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e26bedb1db4c6c8597e4c8aba9a3ae', 'request_id': 'req-a671cfd9-4196-42bc-9092-eecd158a350c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:15.953686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] The token cache is being invalidate because project a2e26bedb1db4c6c8597e4c8aba9a3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:15.953980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:15.954651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a671cfd9-4196-42bc-9092-eecd158a350c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:15.956610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1217/2431] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:15 2022] DELETE /identity/v3/projects/a2e26bedb1db4c6c8597e4c8aba9a3ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:15.961789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:15.962310 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:15.962496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:15.991239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:15.992457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:16.079274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1215/2432] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:16.087825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.088046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.088267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.143054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:16.144419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:16.165362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1218/2433] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:16.167133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.181130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16cb3-38b3-4243-bb00-8930f2c40728 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.199965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.200760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.201263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.201637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.202426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:51:16.202828 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.205312 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.227233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1216/2434] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:51:16.233459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.261927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac390-8085-4463-9412-841f5f575fd1 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.284777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.285464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.285741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.286008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.286654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.288570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.365136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1219/2435] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:16 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:16.369199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.380889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eebdcd-f441-40cd-bd11-b108a490dae3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.614390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.617347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.619737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.620883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.624877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.628694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.696266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1217/2436] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:16 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:16.700513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.720759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603783-5cc3-428f-9e70-255f311a258d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.736582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.737288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.737648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.737928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.738608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.740278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.758528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1220/2437] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:16.763351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.798568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5b99-7193-46bc-acaf-8b349863ad5b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.836676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.841458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.842717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.844929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.846001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.861542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680717d-d7a5-46fa-af6e-59b3394cc8fd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.900049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1218/2438] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:16.902059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.915394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869023-7be3-478f-86eb-d0ecbbe2a515 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.921563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.923082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.923642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.924016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] PATH_INFO: `/v3/projects/7cf6d44911834e919e2214bfcbb18871/users/4a1848e637bd43cd89175aff2f15c2e3/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.945043 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf6d44911834e919e2214bfcbb18871, user_id=4a1848e637bd43cd89175aff2f15c2e3, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.947992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.983278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1221/2439] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:16 2022] PUT /identity/v3/projects/7cf6d44911834e919e2214bfcbb18871/users/4a1848e637bd43cd89175aff2f15c2e3/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:17.000052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:17.000616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:17.000844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:17.097599 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] MFA Rules not processed for user `4a1848e637bd43cd89175aff2f15c2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:17.098999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:17.214812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:17.321758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1219/2440] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:17.336376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:17.338200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:17.513894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d6ad-171d-47ad-8bf2-a1ba549a43e0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:17.532229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:17.533196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:17.534232 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:17.534742 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:17.568149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:17.571735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d515-8a9a-4f4e-ba50-53a3e3f3e3a3 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:17.596259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1222/2441] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:17.624875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:17.748122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20a36-5423-4327-bf15-49452008f1b2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:17.754037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:17.755361 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:17.755702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:17.755971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] PATH_INFO: `/v3/users/4a1848e637bd43cd89175aff2f15c2e3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:17.758705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1848e637bd43cd89175aff2f15c2e3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:17.761378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:17.941116 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1848e637bd43cd89175aff2f15c2e3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:17.994583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1848e637bd43cd89175aff2f15c2e3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:18.012086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1848e637bd43cd89175aff2f15c2e3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:18.014634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1848e637bd43cd89175aff2f15c2e3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:18.015960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1848e637bd43cd89175aff2f15c2e3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:18.054836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1220/2442] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:17 2022] DELETE /identity/v3/users/4a1848e637bd43cd89175aff2f15c2e3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:18.059607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:18.060183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:18.060349 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:18.107208 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:18.130190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:18.194950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:18.303603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1223/2443] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:18.340722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:18.342600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:18.515280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2cde-5f51-4ec2-be1d-eedb91b5dc4e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:18.525908 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:18.526555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:18.527062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:18.527345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:18.546582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:18.548278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec73b0-6ee9-4b72-9820-553b0edf50a6 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:18.560797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:18.570856 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1221/2444] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:19.465945 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:19.467554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:19.506485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706419e-6a8f-42ed-82f2-702da2ca8839 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:19.523530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:19.524610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:19.525088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:19.525534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] PATH_INFO: `/v3/projects/7cf6d44911834e919e2214bfcbb18871` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:19.530553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf6d44911834e919e2214bfcbb18871)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:19.532693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:19.717684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf6d44911834e919e2214bfcbb18871', 'request_id': 'req-e1a81886-162e-4967-9886-4e8da476c846'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:19.736787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf6d44911834e919e2214bfcbb18871', 'request_id': 'req-e1a81886-162e-4967-9886-4e8da476c846'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:19.752879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf6d44911834e919e2214bfcbb18871', 'request_id': 'req-e1a81886-162e-4967-9886-4e8da476c846'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:19.775797 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] The token cache is being invalidate because project 7cf6d44911834e919e2214bfcbb18871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:19.776117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:19.777922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:19.780502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1224/2445] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:19 2022] DELETE /identity/v3/projects/7cf6d44911834e919e2214bfcbb18871 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:22.726873 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:22.727502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:22.727502 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:22.782319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] MFA Rules not processed for user `d0d69c5d4e5b4475b0b2946502ef51e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:22.783889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:22.910341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1222/2446] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:22.914943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:22.917935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:23.026363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81886-162e-4967-9886-4e8da476c846 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.031871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.032299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.032854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.033234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.034640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.036998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.077249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1225/2447] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:51:23.085746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:23.097618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79cec1-c51f-4c86-9bea-da7befcd5b4b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.167512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.168185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.168465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.168739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.169497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.171366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.203500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1223/2448] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:23 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:23.208777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:23.221033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72c01-248b-4627-93a1-7d8eee8df102 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.226159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.226985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.227323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.227658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.228371 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.230170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.240765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1226/2449] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:23.246353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:23.257192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847739-3dd1-4d07-80a3-37204d73773f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.262033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.262701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.262982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.263359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] PATH_INFO: `/v3/projects/f139931ef99b440e96e4893782978964/users/53bdd586993743b983bf4121925e5f23/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.283330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f139931ef99b440e96e4893782978964, user_id=53bdd586993743b983bf4121925e5f23, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.286055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.305052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1224/2450] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:23 2022] PUT /identity/v3/projects/f139931ef99b440e96e4893782978964/users/53bdd586993743b983bf4121925e5f23/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:23.308926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:23.319821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794687d9-ca0e-4d31-b39a-db3a6d08fc15 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.349584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:23.402238 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.403434 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.403815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.404182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.404990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.406775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad95109-6344-4cca-bff0-573d85893afb admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.424046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:23.432277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1227/2451] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:23.437823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94387239-9ab9-46d5-a3b1-f534423fa083 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.443997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.445124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.445440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.445845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] PATH_INFO: `/v3/projects/f139931ef99b440e96e4893782978964/users/53bdd586993743b983bf4121925e5f23/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.452048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f139931ef99b440e96e4893782978964, user_id=53bdd586993743b983bf4121925e5f23, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.455537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49227c25-5580-4e98-aea0-98b674b6a1eb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.475533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1225/2452] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:23 2022] PUT /identity/v3/projects/f139931ef99b440e96e4893782978964/users/53bdd586993743b983bf4121925e5f23/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:24.692294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:24.692778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:24.692875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:24.719613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] MFA Rules not processed for user `bee132c315de41cb91a5fce6e3bd4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:24.721074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:24.811831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1228/2453] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:32.402370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:32.403287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:32.404005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:32.437415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] MFA Rules not processed for user `53bdd586993743b983bf4121925e5f23`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:32.438559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:32.478841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:32.558425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1226/2454] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:32.582288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:32.584008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:32.711761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ca1cd-46ca-4607-a7be-7a6eeea4403f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:32.733313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:32.735409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:32.770075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:32.770895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:32.772650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:32.773126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:32.907192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:32.908847 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6559c8-cafe-4ecd-bc4e-eb5277943181 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:32.923556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1229/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:32.981237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4b51e-c197-4974-a908-21c8974b7f96 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:32.986516 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:32.987358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:32.988089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:32.988506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] PATH_INFO: `/v3/users/2b55c9b70929464b956c38a11b500ce5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:32.990504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b55c9b70929464b956c38a11b500ce5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:32.993142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:33.116747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b55c9b70929464b956c38a11b500ce5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:33.155026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b55c9b70929464b956c38a11b500ce5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:33.164539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b55c9b70929464b956c38a11b500ce5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:33.165345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b55c9b70929464b956c38a11b500ce5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:33.166566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b55c9b70929464b956c38a11b500ce5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:33.188151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1227/2456] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:51:32 2022] DELETE /identity/v3/users/2b55c9b70929464b956c38a11b500ce5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:51:33.189557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:33.189854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:33.190139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:33.202381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:33.234487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:33.234487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:33.319964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1230/2457] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:33.575436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:33.577230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:33.645582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:33.653726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d0ec1-5d35-47b3-9ce7-9a0004d4830b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:33.658975 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:33.659481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:33.660219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:33.661193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:33.672578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:33.674295 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47fc7c-4769-4ccb-ab5a-96ae3b17d5f9 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:33.687096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1228/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:34.254353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:34.255777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:34.276260 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c539bc-6942-41ca-b2f2-8ef09c4137c3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:34.288230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:34.288916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:34.289219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:34.289536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] PATH_INFO: `/v3/projects/fffff978c3e641e585af7092f0d5b28c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:34.290789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fffff978c3e641e585af7092f0d5b28c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:34.292944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:34.493906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffff978c3e641e585af7092f0d5b28c', 'request_id': 'req-79b450d1-e113-4377-8bdf-7ad97b6f6970'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:34.514784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffff978c3e641e585af7092f0d5b28c', 'request_id': 'req-79b450d1-e113-4377-8bdf-7ad97b6f6970'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:34.527038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffff978c3e641e585af7092f0d5b28c', 'request_id': 'req-79b450d1-e113-4377-8bdf-7ad97b6f6970'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:34.570240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] The token cache is being invalidate because project fffff978c3e641e585af7092f0d5b28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:51:34.570539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:34.571249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-79b450d1-e113-4377-8bdf-7ad97b6f6970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:51:34.574142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1231/2459] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:51:34 2022] DELETE /identity/v3/projects/fffff978c3e641e585af7092f0d5b28c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:34.580184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:34.580748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:34.580858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:34.658847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:34.661335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:34.841183 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1229/2460] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:34.903982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:34.904531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:34.905023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:34.956132 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:34.957426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:34.988988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1232/2461] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:34.993676 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.010498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9431-a305-4d45-9396-2da5687cb9e6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.022697 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.023334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.023616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.023961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.026114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:51:35.026499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.028420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.049064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1230/2462] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:51:35.053281 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.068954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba220b-0a41-4d64-ab91-7c9c3b1aab5f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.085841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.086114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.086283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.086882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.087192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.089906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.150890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1233/2463] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:51:35 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:35.155522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.171977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db756c-74f0-42ac-ad66-d47be6481307 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.288804 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.289566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.289917 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.290259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.291017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.293205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6d50-53da-406b-8a37-37573a05f152 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.319105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1231/2464] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:51:35 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:51:35.323612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.336594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217375-dca4-487e-8f76-ba87d0379329 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.342796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.343544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.343848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.344215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.345567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.347967 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.364983 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1234/2465] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:35.367298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed423f5-87b6-4834-9b55-2e2044af574a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.367653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed423f5-87b6-4834-9b55-2e2044af574a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.367991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed423f5-87b6-4834-9b55-2e2044af574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.369973 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.380816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbe9b-6ccf-48d1-997b-b43d2a1a069c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.386632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.387337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.387692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.388032 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.388753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.389939 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1ed423f5-87b6-4834-9b55-2e2044af574a None None] MFA Rules not processed for user `d0d69c5d4e5b4475b0b2946502ef51e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:35.390509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.391260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1ed423f5-87b6-4834-9b55-2e2044af574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:35.402504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1235/2466] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:51:35.409477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.420335 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4a49-2e37-4ded-acdf-34f64eabf5e1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.427131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.427828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.428986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.429265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] PATH_INFO: `/v3/projects/78b68410511248e8b96cadf52ff89417/users/7b5b571366e6499e8f0b5598c1263324/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.445426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b68410511248e8b96cadf52ff89417, user_id=7b5b571366e6499e8f0b5598c1263324, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.448091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.457639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1232/2467] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:35.465825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1236/2468] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:51:35 2022] PUT /identity/v3/projects/78b68410511248e8b96cadf52ff89417/users/7b5b571366e6499e8f0b5598c1263324/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:51:35.476448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc21a-a817-4c0e-9252-36b3aa992b86 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.476733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc21a-a817-4c0e-9252-36b3aa992b86 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.477039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc21a-a817-4c0e-9252-36b3aa992b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.501440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:35.511087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-909cc21a-a817-4c0e-9252-36b3aa992b86 None None] MFA Rules not processed for user `7b5b571366e6499e8f0b5598c1263324`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:35.513217 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-909cc21a-a817-4c0e-9252-36b3aa992b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:35.617848 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1233/2469] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:35.638253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:35.640202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:35.663868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:35.732327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82750e-ee7f-4d8a-a435-ba6987aa9ee7 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:35.736103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:35.736730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.737026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.737460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.749126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:35.750618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:35.761282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1237/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:37.275399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28a12-6593-4c97-9a23-50b5e4a8d159 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:37.275952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28a12-6593-4c97-9a23-50b5e4a8d159 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:37.276166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28a12-6593-4c97-9a23-50b5e4a8d159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:37.296547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f1f28a12-6593-4c97-9a23-50b5e4a8d159 None None] MFA Rules not processed for user `7b5b571366e6499e8f0b5598c1263324`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:37.297799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f1f28a12-6593-4c97-9a23-50b5e4a8d159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:37.305782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1234/2471] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:51:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:37.426088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:37.427720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:37.496898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89219-4453-4781-9b4e-8cf44cbff92a service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:37.501462 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:37.502365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:37.502838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:37.503321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:37.505747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:37.587826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:37.589279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:37.600429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1238/2472] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:37.747959 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13cfe-80f0-4b6d-9b20-5ed80e932acb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:37.748553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13cfe-80f0-4b6d-9b20-5ed80e932acb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:37.748951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13cfe-80f0-4b6d-9b20-5ed80e932acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:37.769244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-13f13cfe-80f0-4b6d-9b20-5ed80e932acb None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:37.770485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-13f13cfe-80f0-4b6d-9b20-5ed80e932acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:37.886402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1235/2473] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:51:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:37.902875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:37.907307 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:38.017247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fde2-8817-4465-97d2-5b2aa898a4a8 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:38.024274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:38.025364 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:38.025712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:38.026666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:38.037350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:38.040554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:38.043606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:38.056729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1239/2474] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:51:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:51:47.867781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=55 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:48.057547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:00.127625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:00.128213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:00.128314 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:00.148749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:00.150053 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:00.157493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1236/2475] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:52:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:52:00.171072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:00.181610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d43d8-e2ea-43c2-bea1-a70f0d9eea7b service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:00.186782 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:00.187395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:00.187670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:00.187936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:00.197059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:00.198672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:00.208306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1240/2476] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:52:02.201410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:02.202960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:02.273309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ccdd1-fdd8-4485-9bf1-fdc0374424ee None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:02.278221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:02.278867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.279121 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.279390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] PATH_INFO: `/v3/users/fe00be41c3c340fa914f8a1e8603928f` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.280545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe00be41c3c340fa914f8a1e8603928f)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:02.282515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:02.333294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe00be41c3c340fa914f8a1e8603928f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.346284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe00be41c3c340fa914f8a1e8603928f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.353878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe00be41c3c340fa914f8a1e8603928f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.354890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe00be41c3c340fa914f8a1e8603928f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.355797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-a5b232de-a2e0-4caa-b400-0424f22d889c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe00be41c3c340fa914f8a1e8603928f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.371042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1237/2477] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:52:02 2022] DELETE /identity/v3/users/fe00be41c3c340fa914f8a1e8603928f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:02.564846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:02.576299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f710519-f5ab-48f4-a9b7-de6e2b9c57da service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:02.649113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:02.649754 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.650030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.650293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] PATH_INFO: `/v3/projects/758c27a6ef5040158ab64524193f1e63` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.651701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] RBAC: Authorizing `identity:delete_project(project_id=758c27a6ef5040158ab64524193f1e63)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:02.653825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:02.707123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758c27a6ef5040158ab64524193f1e63', 'request_id': 'req-0249f024-f19b-46ef-91cf-f0b2aa5730de'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.713087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758c27a6ef5040158ab64524193f1e63', 'request_id': 'req-0249f024-f19b-46ef-91cf-f0b2aa5730de'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.723122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758c27a6ef5040158ab64524193f1e63', 'request_id': 'req-0249f024-f19b-46ef-91cf-f0b2aa5730de'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.736497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] The token cache is being invalidate because project 758c27a6ef5040158ab64524193f1e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:52:02.736834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.737544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0249f024-f19b-46ef-91cf-f0b2aa5730de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:02.742497 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1241/2478] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:52:02 2022] DELETE /identity/v3/projects/758c27a6ef5040158ab64524193f1e63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:02.744201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.744482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.744748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.769271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:02.770496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:02.839246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1238/2479] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:02.848008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.848341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.848553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.871046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:02.872324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:02.882101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1242/2480] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:02.886977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:02.898622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a01cd-59c5-4b5d-bb19-447f8da9e6ae None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:02.905888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:02.906850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.907132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.907636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.908201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:52:02.908595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:02.910276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:02.922335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:02.926367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1239/2481] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:52:02.930303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:02.939789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f962c5-37b4-4d07-907e-04bda150303e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:02.944494 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:02.945115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:02.945395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:02.945661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:02.946303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:02.948245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:02.982052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1243/2482] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:52:02 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:52:02.986732 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:02.999840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749fd6-3042-4fd1-8665-e884ddf12ba1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:03.063920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:03.064559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.064880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.065200 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.065844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:03.067778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:03.094440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1240/2483] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:52:02 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:52:03.099012 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:03.111265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e69c5-f62c-4615-a552-88a519bc09f6 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:03.117231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:03.117845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.118120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.118380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.119022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:03.120632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:03.131675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1244/2484] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:03.135912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:03.146483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef42f-588d-48cf-b3fd-50735d69d27f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:03.151935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:03.152533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.152811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.153083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.153754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:03.155345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dfab-31fe-4d9a-b274-98cfed81a883 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:03.166888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1241/2485] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:03.170991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:03.181054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f141-f7d6-4ba0-ab4b-96e31dc62295 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:03.185796 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:03.186437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.186711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.186976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] PATH_INFO: `/v3/projects/2ad2eb029dbb47b6a82080e152916eca/users/ba0ec1de46644109bc172b1e2c9e2afd/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.201395 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad2eb029dbb47b6a82080e152916eca, user_id=ba0ec1de46644109bc172b1e2c9e2afd, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:03.204014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:03.220397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1245/2486] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:52:03 2022] PUT /identity/v3/projects/2ad2eb029dbb47b6a82080e152916eca/users/ba0ec1de46644109bc172b1e2c9e2afd/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:03.230755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b981f6-efe2-4860-9528-d0cebaf704fa None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.231260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b981f6-efe2-4860-9528-d0cebaf704fa None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.231381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b981f6-efe2-4860-9528-d0cebaf704fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.261430 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-46b981f6-efe2-4860-9528-d0cebaf704fa None None] MFA Rules not processed for user `ba0ec1de46644109bc172b1e2c9e2afd`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:03.262683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-46b981f6-efe2-4860-9528-d0cebaf704fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:03.330834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1242/2487] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:03.345575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:03.347409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:03.362272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:03.410688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c16b-40e1-42dd-b49c-8edf1a5a0f8c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:03.414979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:03.415588 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:03.415868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:03.416184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:03.425220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:03.426654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:03.435998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1246/2488] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:05.911489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb4c16-f8e4-410d-90ec-49cb7d6f448f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:05.911991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb4c16-f8e4-410d-90ec-49cb7d6f448f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:05.911991 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb4c16-f8e4-410d-90ec-49cb7d6f448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:05.932905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-afdb4c16-f8e4-410d-90ec-49cb7d6f448f None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:05.934587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-afdb4c16-f8e4-410d-90ec-49cb7d6f448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:06.002000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1243/2489] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:52:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:06.031947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:06.031947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:06.103623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b0e5a-7a7b-4a15-9064-d589d6adf6fc service glance] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:06.109031 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c336a-a81c-431f-a151-27254948b438 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:06.109664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c336a-a81c-431f-a151-27254948b438 service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:06.109984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c336a-a81c-431f-a151-27254948b438 service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:06.110254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c336a-a81c-431f-a151-27254948b438 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:06.121243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c336a-a81c-431f-a151-27254948b438 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:06.122974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c336a-a81c-431f-a151-27254948b438 service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:06.133284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1247/2490] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:52:06.716058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d9fa-91e7-48e6-9c20-e25740122542 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:06.716349 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d9fa-91e7-48e6-9c20-e25740122542 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:06.716634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d9fa-91e7-48e6-9c20-e25740122542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:06.738329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c448d9fa-91e7-48e6-9c20-e25740122542 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:06.739658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c448d9fa-91e7-48e6-9c20-e25740122542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:06.747948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1244/2491] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:06.762700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c336a-a81c-431f-a151-27254948b438 service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:06.773213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c336a-a81c-431f-a151-27254948b438 service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:06.778650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:06.779251 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:06.779527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:06.779791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:06.788532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:06.790142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:06.799104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1248/2492] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:52:07.042851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08dcde-ef90-4224-bc35-3802f8680068 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:07.043284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08dcde-ef90-4224-bc35-3802f8680068 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:07.043397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08dcde-ef90-4224-bc35-3802f8680068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:07.057905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:07.065520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-2d08dcde-ef90-4224-bc35-3802f8680068 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:07.067447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-2d08dcde-ef90-4224-bc35-3802f8680068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:07.088689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1245/2493] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:07.100799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:07.111792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25bc84-cd64-4eb7-ab6a-eae553104fd8 service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:07.116873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:07.117544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:07.117895 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:07.118125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:07.127168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:07.128816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:07.137476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1249/2494] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:52:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:52:07.488319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:07.488608 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:07.488885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:07.509084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:07.510292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:07.519693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1246/2495] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:07.532837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:07.544270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af5f30-5adc-4650-8783-5a0b878b1852 service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:07.551561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:07.552517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:07.552637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:07.552921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:07.562907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:07.564661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85134ffb-dc6d-48af-99ca-46d420a958eb service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:07.574156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1250/2496] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:52:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:52:09.740095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:09.741672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:09.821207 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759be07-8a67-48cf-9d5b-d14de12a45b1 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:09.826788 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:09.827508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:09.827757 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:09.828108 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] PATH_INFO: `/v3/users/7b5b571366e6499e8f0b5598c1263324` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:09.829412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5b571366e6499e8f0b5598c1263324)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:09.831704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:09.882639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5b571366e6499e8f0b5598c1263324'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:09.895431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5b571366e6499e8f0b5598c1263324'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:09.902370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5b571366e6499e8f0b5598c1263324'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:09.903256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5b571366e6499e8f0b5598c1263324'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:09.903906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5b571366e6499e8f0b5598c1263324'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:09.919227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1247/2497] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:52:09 2022] DELETE /identity/v3/users/7b5b571366e6499e8f0b5598c1263324 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:09.924541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:09.925103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:09.925226 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:09.945648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:09.946877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:10.012324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1251/2498] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:10.026179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:10.027713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:10.090263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f9a-0aaf-4712-82e4-be32104c6903 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:10.097595 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:10.098252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:10.098539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:10.098820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:10.110173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:10.111680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:10.121782 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1248/2499] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:10.307297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:10.309345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:10.323076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a355ac6-3d8f-435b-9f66-d2cae42c0870 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:10.328268 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:10.328846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:10.329159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:10.329535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] PATH_INFO: `/v3/projects/78b68410511248e8b96cadf52ff89417` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:10.330999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b68410511248e8b96cadf52ff89417)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:10.333028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:10.334866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:10.386188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b68410511248e8b96cadf52ff89417', 'request_id': 'req-8f324625-27b0-4bd9-bfa9-d908d5559008'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:10.393180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b68410511248e8b96cadf52ff89417', 'request_id': 'req-8f324625-27b0-4bd9-bfa9-d908d5559008'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:10.402372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b68410511248e8b96cadf52ff89417', 'request_id': 'req-8f324625-27b0-4bd9-bfa9-d908d5559008'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:10.417928 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] The token cache is being invalidate because project 78b68410511248e8b96cadf52ff89417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:52:10.418214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:10.418869 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:10.420662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1252/2500] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:52:10 2022] DELETE /identity/v3/projects/78b68410511248e8b96cadf52ff89417 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:11.501596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:11.503190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:11.516860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564e2e0-98e4-4939-8bc8-7950588ec5aa service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:11.528869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:11.572283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:11.572900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:11.573212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:11.573490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:11.575494 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:11.656481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:11.658164 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129b8f-0c7f-432f-8ae7-07882cd7d274 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:11.668567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1249/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:20.414676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:21.663436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=43 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:27.629321 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:27.631252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:27.702642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324625-27b0-4bd9-bfa9-d908d5559008 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:27.708504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:27.709179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.709464 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.709738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] PATH_INFO: `/v3/users/ba0ec1de46644109bc172b1e2c9e2afd` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:27.710894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0ec1de46644109bc172b1e2c9e2afd)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:27.712806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:27.764834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0ec1de46644109bc172b1e2c9e2afd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:27.776149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0ec1de46644109bc172b1e2c9e2afd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:27.783602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0ec1de46644109bc172b1e2c9e2afd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:27.784814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0ec1de46644109bc172b1e2c9e2afd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:27.797191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0ec1de46644109bc172b1e2c9e2afd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:27.803130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1253/2502] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:52:27 2022] DELETE /identity/v3/users/ba0ec1de46644109bc172b1e2c9e2afd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:27.807775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.808621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.808621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:27.827741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:27.830572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:27.894055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1250/2503] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:52:27.906325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:27.908088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:27.984651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b76d-bfc0-4263-b777-2b30ec6bbe25 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:27.990316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:27.991851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.992244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.992624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.005195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.007039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b20a-5ac7-4755-8739-cc56a682236a service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.021741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1254/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:52:28.475147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.476597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:28.488835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8ceac-8a25-46ea-ada8-d92830634519 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.498992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.499936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.500449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.500710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] PATH_INFO: `/v3/projects/2ad2eb029dbb47b6a82080e152916eca` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.502036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad2eb029dbb47b6a82080e152916eca)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.504253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.559910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad2eb029dbb47b6a82080e152916eca', 'request_id': 'req-c6d239b2-441b-473e-9164-7fe9864afedb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:28.566644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad2eb029dbb47b6a82080e152916eca', 'request_id': 'req-c6d239b2-441b-473e-9164-7fe9864afedb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:28.572118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad2eb029dbb47b6a82080e152916eca', 'request_id': 'req-c6d239b2-441b-473e-9164-7fe9864afedb'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:28.586843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] The token cache is being invalidate because project 2ad2eb029dbb47b6a82080e152916eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:52:28.587136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:28.587753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-c6d239b2-441b-473e-9164-7fe9864afedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:28.589392 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1251/2505] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:52:28 2022] DELETE /identity/v3/projects/2ad2eb029dbb47b6a82080e152916eca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:28.595002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.595392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.595763 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.617457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:28.618798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:28.637548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:28.683819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1255/2506] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:28.691538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.691825 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.692100 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.712629 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:28.713885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:28.722550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1252/2507] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:28.727006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.737305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4417f-2dc4-4eca-bfbc-d00f093a9ffa None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.742036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.742645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.742919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.743187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.743832 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:52:28.744128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.746065 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.758426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1256/2508] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:52:28.763302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.773491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a62c-705e-411c-9823-13c9baca5216 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.779166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.779836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.780114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.780390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.781035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.783101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.814561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1253/2509] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:52:28 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:52:28.819014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.829436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1a027-a557-472a-8d5b-20e5ae3e07e9 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.888127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.888725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.889008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.889291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.889913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.891820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.914272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1257/2510] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:52:28 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:52:28.918686 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.929222 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7776-e005-423a-9efe-11b1e9fe3e69 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.934092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.934692 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.934969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.935241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.935907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.937566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.947410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1254/2511] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:28.951536 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.962818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3038b-75ac-4e66-a2b5-ac12915d471d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:28.969165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:28.969801 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:28.970079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:28.970347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:28.970997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.972641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474faa-bdd4-4ecd-887a-3611286dc5fd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.984293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1258/2512] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:28.988726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:28.999464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f4e70-07cd-444a-a63d-3cd38f522677 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:29.004852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:29.005610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:29.005891 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:29.006162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] PATH_INFO: `/v3/projects/bfd8581bd26a4e299ee879fc72b2c2f0/users/c0a72960e0234c20a9308af0cf17ebd0/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:29.021829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd8581bd26a4e299ee879fc72b2c2f0, user_id=c0a72960e0234c20a9308af0cf17ebd0, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:29.024496 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:29.040895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1255/2513] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:52:28 2022] PUT /identity/v3/projects/bfd8581bd26a4e299ee879fc72b2c2f0/users/c0a72960e0234c20a9308af0cf17ebd0/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:29.052435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:29.052727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:29.053027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:29.082117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] MFA Rules not processed for user `c0a72960e0234c20a9308af0cf17ebd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:29.083493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:29.155186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1259/2514] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:29.166736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:29.168764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:29.191141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:29.231174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c1e4-9569-4c52-95de-13b72d050c50 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:29.234847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:29.235461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:29.235736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:29.236039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:29.244318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:29.246111 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a11e1-13c5-49ca-bddc-b21c6b021c66 service glance] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:29.255042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1256/2515] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:39.151975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:39.251067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=17 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:52.066700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:52.139456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7a159-be41-4273-9d9a-fcffbfa66a6d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:52.145320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:52.145953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:52.146236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:52.146505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] PATH_INFO: `/v3/users/c0a72960e0234c20a9308af0cf17ebd0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:52.147727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a72960e0234c20a9308af0cf17ebd0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:52.150179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:52.202554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a72960e0234c20a9308af0cf17ebd0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.214962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a72960e0234c20a9308af0cf17ebd0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.228221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a72960e0234c20a9308af0cf17ebd0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.228927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a72960e0234c20a9308af0cf17ebd0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.242729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a72960e0234c20a9308af0cf17ebd0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.248816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1260/2516] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:52:52 2022] DELETE /identity/v3/users/c0a72960e0234c20a9308af0cf17ebd0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:52.255513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:52.256231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:52.256231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:52.284077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:52.285346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:52.369637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1257/2517] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:52.382024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:52.383764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:52.475006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9e67-6bcc-4a04-91e4-c476aafc5f32 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:52.479746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:52.480486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:52.480771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:52.481077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:52.496564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:52.498073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d78893-367f-4a9e-948f-891f8b265b94 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:52.511657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1261/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:52.847146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:52.848711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:52.869316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8a67-55ab-4de9-a0d7-c43e351196c8 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:52.874701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:52.875744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:52.876240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:52.876682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] PATH_INFO: `/v3/projects/bfd8581bd26a4e299ee879fc72b2c2f0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:52.879514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd8581bd26a4e299ee879fc72b2c2f0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:52.882961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:52.939490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd8581bd26a4e299ee879fc72b2c2f0', 'request_id': 'req-ebc193a9-e58a-4f23-98e0-09bb5a07820f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.946212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd8581bd26a4e299ee879fc72b2c2f0', 'request_id': 'req-ebc193a9-e58a-4f23-98e0-09bb5a07820f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.952679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd8581bd26a4e299ee879fc72b2c2f0', 'request_id': 'req-ebc193a9-e58a-4f23-98e0-09bb5a07820f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.971059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] The token cache is being invalidate because project bfd8581bd26a4e299ee879fc72b2c2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:52:52.971522 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.972512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ebc193a9-e58a-4f23-98e0-09bb5a07820f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:52:52.975042 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1258/2519] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:52:52 2022] DELETE /identity/v3/projects/bfd8581bd26a4e299ee879fc72b2c2f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:52:52.980057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:52.980361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:52.980640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.002097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:53.003450 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:53.027254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:53.098204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1262/2520] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:53.106330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.106637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.106883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.140586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:53.142138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:53.156445 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1259/2521] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:53.161125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.173684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f580950-61c2-4132-aa92-d1c0a5068483 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.180320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.181365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.181864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.182180 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.183169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:52:53.183556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.185655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.209673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1263/2522] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:52:53.211491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.227923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c00af-1c51-4d54-9443-7e4cafa4dab0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.233460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.234223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.234485 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.234787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.235591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.237623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.274506 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1260/2523] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:52:53 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:52:53.275578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.287274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff35b-0783-43bf-9fda-8c748387850e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.349026 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.349656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.349943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.350218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.350874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.352826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.376303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1264/2524] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:52:53 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:52:53.380656 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.391072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d73cf-efba-4b93-9695-7d202eb28210 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.395976 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.396576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.396839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.397198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.397948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.399568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.409868 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1261/2525] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:53.414041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.424657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cd6ab-33e6-4252-9c13-3d3afcef5c1f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.430003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.430727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.431008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.431332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.432017 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.433946 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778f40-80d8-4b4e-873d-cd2fc9a4233e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.445599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1265/2526] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:53.449841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.460741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a533-057e-4405-b7f4-7c9834dfebfe admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.465547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.466201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.466481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.466765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] PATH_INFO: `/v3/projects/f0967096f27a4696bb8b8c94b872945e/users/d7ef54e42ff446f592edc8a4cc62f67a/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.483810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0967096f27a4696bb8b8c94b872945e, user_id=d7ef54e42ff446f592edc8a4cc62f67a, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.489546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.500778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1262/2527] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:52:53 2022] PUT /identity/v3/projects/f0967096f27a4696bb8b8c94b872945e/users/d7ef54e42ff446f592edc8a4cc62f67a/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:52:53.512300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b702a-d265-4dfd-80cf-17a3bdd31cad None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.512589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b702a-d265-4dfd-80cf-17a3bdd31cad None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.512891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b702a-d265-4dfd-80cf-17a3bdd31cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.543571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3e3b702a-d265-4dfd-80cf-17a3bdd31cad None None] MFA Rules not processed for user `d7ef54e42ff446f592edc8a4cc62f67a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:53.544805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3e3b702a-d265-4dfd-80cf-17a3bdd31cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:53.616223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1266/2528] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:53.627721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:53.629862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:53.657785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:53.696543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e0b2-a955-44ab-8da2-88d24742350e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:53.701215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:53.701849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:53.702146 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:53.702409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:53.712192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:53.713679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:53.722941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1263/2529] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:54.497423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec011-0ec2-449d-8ce3-0d2adbfeaaf0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:54.497891 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec011-0ec2-449d-8ce3-0d2adbfeaaf0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:54.497995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec011-0ec2-449d-8ce3-0d2adbfeaaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:54.518963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2e6ec011-0ec2-449d-8ce3-0d2adbfeaaf0 None None] MFA Rules not processed for user `bee132c315de41cb91a5fce6e3bd4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:54.520246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2e6ec011-0ec2-449d-8ce3-0d2adbfeaaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:54.533027 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:54.579294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1267/2530] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:03.718724 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=17 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:03.904751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:03.978864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df3c9-56fc-45db-bf56-bf263ad253ea service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:03.985023 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:03.985673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:03.985947 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:03.986215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] PATH_INFO: `/v3/users/d7ef54e42ff446f592edc8a4cc62f67a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:03.987512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ef54e42ff446f592edc8a4cc62f67a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:03.989510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:04.042048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ef54e42ff446f592edc8a4cc62f67a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.054490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ef54e42ff446f592edc8a4cc62f67a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.061315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ef54e42ff446f592edc8a4cc62f67a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.062000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ef54e42ff446f592edc8a4cc62f67a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.062619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ef54e42ff446f592edc8a4cc62f67a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.077737 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1264/2531] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:53:03 2022] DELETE /identity/v3/users/d7ef54e42ff446f592edc8a4cc62f67a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:04.083205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:04.083712 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:04.083816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:04.103433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:04.104630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:04.165303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1268/2532] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:04.175081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:04.176672 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:04.241895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eaff9-90a9-4287-ae94-38beeec24ff6 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:04.245929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:04.246537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:04.246807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:04.247077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:04.257348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:04.258784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:04.268897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1265/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:53:04.547998 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:04.549815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:04.563178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd9422-d998-4cce-b93c-c5fdc3788876 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:04.568336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:04.569124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:04.569295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:04.569568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] PATH_INFO: `/v3/projects/f0967096f27a4696bb8b8c94b872945e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:04.570725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0967096f27a4696bb8b8c94b872945e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:04.572745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:04.625931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0967096f27a4696bb8b8c94b872945e', 'request_id': 'req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.631792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0967096f27a4696bb8b8c94b872945e', 'request_id': 'req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.641097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0967096f27a4696bb8b8c94b872945e', 'request_id': 'req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.652183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] The token cache is being invalidate because project f0967096f27a4696bb8b8c94b872945e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:53:04.652461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.653139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-c062fbec-7f6e-4194-bcf3-9e9cc4810d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:04.654657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1269/2534] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:53:04 2022] DELETE /identity/v3/projects/f0967096f27a4696bb8b8c94b872945e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:12.745604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:12.747158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:12.776885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:12.828594 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b776a-88f9-415a-a8f1-195e806797a3 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:12.892949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:12.893693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:12.893978 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:12.894250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:12.896396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:12.908535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:12.910216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d9990-339f-4fff-b3ba-df2d001191f8 service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:12.921448 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1266/2535] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:53:14.649243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:16.663133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:16.663756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:16.663756 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:16.683644 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] MFA Rules not processed for user `fd8160b9e33e4eebb02d8908ebc5f696`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:16.684937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:16.745995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1270/2536] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:22.916375 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=48 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:26.737642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=25 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:30.797988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:30.798444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:30.798597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:30.818878 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:30.820253 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:30.876301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1267/2537] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:53:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:30.924300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:30.925819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:31.003544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852862d-e4f3-4a45-b165-cbbd31a7f21f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:31.010153 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:31.010787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:31.011071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:31.011358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:31.026806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:31.028448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:31.039097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1271/2538] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:53:38.840379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:38.841851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:38.914187 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f893e5-50fb-42f6-9653-73641aa7bffe None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:38.918787 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:38.919425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:38.919708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:38.919982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] PATH_INFO: `/v3/users/403abcd329c845089083a84cc877ec41` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:38.921167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403abcd329c845089083a84cc877ec41)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:38.923113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:38.975367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403abcd329c845089083a84cc877ec41'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:38.989309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403abcd329c845089083a84cc877ec41'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:38.996811 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403abcd329c845089083a84cc877ec41'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:38.997582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403abcd329c845089083a84cc877ec41'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:38.998194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403abcd329c845089083a84cc877ec41'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.012317 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1268/2539] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:53:38 2022] DELETE /identity/v3/users/403abcd329c845089083a84cc877ec41 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:39.202509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:39.214753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200b06-f3c6-43c3-b56f-0f1dca3ff16d service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:39.278394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:39.279030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:39.279311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:39.279579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] PATH_INFO: `/v3/projects/cb8699318128426d9bfb6310e019ecb4` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:39.280698 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8699318128426d9bfb6310e019ecb4)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:39.282768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:39.340713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8699318128426d9bfb6310e019ecb4', 'request_id': 'req-6aac83c6-423e-44a3-a081-38f0432693e2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.346205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8699318128426d9bfb6310e019ecb4', 'request_id': 'req-6aac83c6-423e-44a3-a081-38f0432693e2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.354602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8699318128426d9bfb6310e019ecb4', 'request_id': 'req-6aac83c6-423e-44a3-a081-38f0432693e2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.366030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] The token cache is being invalidate because project cb8699318128426d9bfb6310e019ecb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:53:39.366320 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.366972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.368574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1272/2540] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:53:39 2022] DELETE /identity/v3/projects/cb8699318128426d9bfb6310e019ecb4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:39.372898 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:39.374379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:39.391694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d832167-6c14-40be-a367-80865697a2f2 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:39.412602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:39.454424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:39.455324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:39.455601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:39.455872 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] PATH_INFO: `/v3/users/a4505a1d5d2f47f795eb55a1d6bec5d8` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:39.457054 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4505a1d5d2f47f795eb55a1d6bec5d8)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:39.459000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:39.510688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4505a1d5d2f47f795eb55a1d6bec5d8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.523163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4505a1d5d2f47f795eb55a1d6bec5d8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.531660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4505a1d5d2f47f795eb55a1d6bec5d8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.532381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4505a1d5d2f47f795eb55a1d6bec5d8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.533005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4505a1d5d2f47f795eb55a1d6bec5d8'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.548731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1269/2541] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:53:39 2022] DELETE /identity/v3/users/a4505a1d5d2f47f795eb55a1d6bec5d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:39.725882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:39.727435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:39.743067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac83c6-423e-44a3-a081-38f0432693e2 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:39.761331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:39.806470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:39.807117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:39.807392 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:39.807666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] PATH_INFO: `/v3/projects/d297918c42164292928e9116057e333c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:39.808899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d297918c42164292928e9116057e333c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:39.810879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:39.860757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd297918c42164292928e9116057e333c', 'request_id': 'req-f5ad1ed5-e866-49e1-845f-93aeefd6d046'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.866374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd297918c42164292928e9116057e333c', 'request_id': 'req-f5ad1ed5-e866-49e1-845f-93aeefd6d046'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.875542 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd297918c42164292928e9116057e333c', 'request_id': 'req-f5ad1ed5-e866-49e1-845f-93aeefd6d046'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.887044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] The token cache is being invalidate because project d297918c42164292928e9116057e333c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:53:39.887304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.887955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:39.889522 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1273/2542] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:53:39 2022] DELETE /identity/v3/projects/d297918c42164292928e9116057e333c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:49.545250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:49.884301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:53.422674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:53.424300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:53.442793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2720-692f-4e85-aff8-61fd7d7e2658 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:53.513404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:53.514133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:53.514412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:53.514689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] PATH_INFO: `/v3/users/bee132c315de41cb91a5fce6e3bd4c7b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:53.515858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee132c315de41cb91a5fce6e3bd4c7b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:53.517836 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:53.572425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee132c315de41cb91a5fce6e3bd4c7b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.586480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee132c315de41cb91a5fce6e3bd4c7b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.593560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee132c315de41cb91a5fce6e3bd4c7b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.594276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee132c315de41cb91a5fce6e3bd4c7b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.594887 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-ce6594cf-94bf-425b-a13b-26ea3e280171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee132c315de41cb91a5fce6e3bd4c7b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.608625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1270/2543] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:53:53 2022] DELETE /identity/v3/users/bee132c315de41cb91a5fce6e3bd4c7b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:53.785050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:53.786623 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:53.800490 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad1ed5-e866-49e1-845f-93aeefd6d046 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:53.860676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:53.861269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:53.861573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:53.861833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] PATH_INFO: `/v3/projects/f61b8a724b7d4536b7676ca6dc425e41` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:53.862994 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61b8a724b7d4536b7676ca6dc425e41)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:53.865059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:53.914114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61b8a724b7d4536b7676ca6dc425e41', 'request_id': 'req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.919819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61b8a724b7d4536b7676ca6dc425e41', 'request_id': 'req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.927795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61b8a724b7d4536b7676ca6dc425e41', 'request_id': 'req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.939156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] The token cache is being invalidate because project f61b8a724b7d4536b7676ca6dc425e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:53:53.939561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.940197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-7dddb2b1-0cb1-4e53-a359-ba5290f1644c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:53:53.941749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1274/2544] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:53:53 2022] DELETE /identity/v3/projects/f61b8a724b7d4536b7676ca6dc425e41 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:53.947008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:53.947334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:53.947648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:53.969683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:53.970892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:54.037198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1271/2545] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:54.045631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.045916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.046185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.071492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:54.073299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:54.084722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1275/2546] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:54.089472 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.102781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73c908-4805-49fe-b3e8-412280350d92 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.108416 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.109067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.109345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.109613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.110264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:53:54.110564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.112265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.124518 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1272/2547] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:53:54.129169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.138948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228087b0-2629-42dc-9479-4638cf8ede14 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.144340 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.144954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.145259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.145531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.146171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.148078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.181597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1276/2548] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:53:54 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:53:54.182861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.194009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd73a5-10ed-487d-8858-2ebb658c27ce admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.198115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:54.255323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.255933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.256206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.256473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.257127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.259051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.286112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1273/2549] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:53:54 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:53:54.291167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.303332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fec7b-1de8-4a3e-9c8b-68d450ab5736 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.308271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.308874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.309192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.309468 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.310138 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.311775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.321746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1277/2550] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:53:54.325965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.336903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5a141-4aa1-4005-bd93-ee01249bf88e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.343128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.344147 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.344622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.345112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.346215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.349104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb255f-c56a-494b-8478-678f16471101 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.362628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1274/2551] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:53:54.367668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.382571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbe00d-5a1e-4c2a-b6ef-7478264d0740 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.387640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.388324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.388677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.389113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] PATH_INFO: `/v3/projects/e4a1df711400459eb4738809cdcf2760/users/cf9d33eff0cc46e2b40011e4c5cd1005/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.408561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a1df711400459eb4738809cdcf2760, user_id=cf9d33eff0cc46e2b40011e4c5cd1005, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.411341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.429603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1278/2552] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:53:54 2022] PUT /identity/v3/projects/e4a1df711400459eb4738809cdcf2760/users/cf9d33eff0cc46e2b40011e4c5cd1005/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:53:54.436096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbae7-f7b5-4bfe-a919-3ee90aa07a76 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.436603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbae7-f7b5-4bfe-a919-3ee90aa07a76 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.436696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbae7-f7b5-4bfe-a919-3ee90aa07a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.457077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-706dbae7-f7b5-4bfe-a919-3ee90aa07a76 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:54.458279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-706dbae7-f7b5-4bfe-a919-3ee90aa07a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:54.530228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1275/2553] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:54.540476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:54.542438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:54.575389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:53:54.606576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27865e5-769d-4aae-a756-2a277ab0aaaa admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:54.610936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:54.611556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:54.611840 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:54.612114 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:54.622236 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:54.623690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:54.634143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1279/2554] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:53:58.560008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee00e-5077-4da3-a945-e9c8968e8854 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:58.560612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee00e-5077-4da3-a945-e9c8968e8854 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:58.560720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee00e-5077-4da3-a945-e9c8968e8854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:58.602093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b05ee00e-5077-4da3-a945-e9c8968e8854 None None] MFA Rules not processed for user `cf9d33eff0cc46e2b40011e4c5cd1005`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:53:58.605687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b05ee00e-5077-4da3-a945-e9c8968e8854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:58.683512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1276/2555] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:53:58.698661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:53:58.700107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:53:58.786908 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71c46f-e84f-431d-8012-02a9928a379d service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:53:58.792864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:53:58.793509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:53:58.793803 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:53:58.794066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:53:58.803411 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:53:58.805164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:53:58.815426 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1280/2556] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:00.121940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:00.122447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:00.122551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:00.144286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] MFA Rules not processed for user `cf9d33eff0cc46e2b40011e4c5cd1005`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:00.145598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:00.157858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1277/2557] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:08.810491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=48 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:10.137909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:15.292674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:15.295262 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:15.364717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656e42-8fce-4718-9d62-18d198e22bba service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:15.369337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:15.369947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:15.370225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:15.370491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:15.372685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:15.394583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:15.396042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:15.407740 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1281/2558] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:19.920996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:19.922507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:19.935524 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fef5b5-4883-4339-b377-5bf8dcad7b1f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:19.939195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:19.939799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:19.940076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:19.940350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:19.942396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:19.956083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:19.957649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:19.968490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1278/2559] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:23.898054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:23.912604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc85fd-66e4-4b51-8b2b-f75d7c20ae7f service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:23.917509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:23.918123 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:23.918402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:23.918658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:23.921060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:23.986688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:23.988146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:23.998290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1282/2560] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:26.505760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:26.515539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7dae-2581-401b-8f19-e39cb4f4a622 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:26.519808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:26.520415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:26.520691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:26.520957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:26.523135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:26.535901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:26.537534 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:26.547467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1279/2561] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:29.910265 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:29.911987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:29.927809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a1f62-6f95-4eb9-9764-6d7430940d29 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:29.933295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:29.933951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:29.934233 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:29.934507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] PATH_INFO: `/v3/users/fd8160b9e33e4eebb02d8908ebc5f696` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:29.935825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8160b9e33e4eebb02d8908ebc5f696)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:29.937839 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:29.989154 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8160b9e33e4eebb02d8908ebc5f696'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:29.997532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8160b9e33e4eebb02d8908ebc5f696'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.004783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8160b9e33e4eebb02d8908ebc5f696'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.005594 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8160b9e33e4eebb02d8908ebc5f696'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.018089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d9699dd8-a6ce-4e68-bb7b-78e4182f5b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8160b9e33e4eebb02d8908ebc5f696'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.024491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1283/2562] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:54:29 2022] DELETE /identity/v3/users/fd8160b9e33e4eebb02d8908ebc5f696 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:54:30.208241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.220405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8d25-96bd-4d4a-8c6f-9cbef4623c27 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.280347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.281016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.281320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.281601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] PATH_INFO: `/v3/projects/58be3761e1a24433b43356e7c95bb581` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.282756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58be3761e1a24433b43356e7c95bb581)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.284703 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.333331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58be3761e1a24433b43356e7c95bb581', 'request_id': 'req-3f85b70d-2091-406b-81e9-88dec120b055'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.339895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58be3761e1a24433b43356e7c95bb581', 'request_id': 'req-3f85b70d-2091-406b-81e9-88dec120b055'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.345963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58be3761e1a24433b43356e7c95bb581', 'request_id': 'req-3f85b70d-2091-406b-81e9-88dec120b055'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.361758 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] The token cache is being invalidate because project 58be3761e1a24433b43356e7c95bb581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:54:30.362052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.362670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-3f85b70d-2091-406b-81e9-88dec120b055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:30.364214 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1280/2563] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:54:30 2022] DELETE /identity/v3/projects/58be3761e1a24433b43356e7c95bb581 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:54:30.369636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.370084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.370427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.391778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:30.393015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:30.402158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:30.585745 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1284/2564] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:30.593806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.594096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.594862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.616022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:30.617455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:30.629783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1281/2565] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:30.634445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.644493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe038fc-1e7b-464e-9705-da62219c809e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.648997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.649661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.649936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.650202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.650868 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:54:30.651230 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.652830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.665645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1285/2566] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:54:30.670240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.681106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778af48-5353-4244-aeaa-1047a476d047 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.685894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.686583 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.686989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.687265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.687919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.690316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.722474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1282/2567] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:54:30 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:54:30.727353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.737563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842209b4-a11f-44cf-bcb4-5bf4f8cfe87d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.795229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.795845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.796124 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.796403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.797051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.798972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.822290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1286/2568] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:54:30 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:54:30.826614 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.837842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e96b-28fb-4acc-b6f1-ddc3a2800401 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.842860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.843463 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.843747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.844022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.844670 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.846346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.856609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1283/2569] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:54:30.860624 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.871047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136418f5-6680-461b-a5c1-6c749213fe68 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.876472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.877110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.877383 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.877645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.878287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.879874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545994d-1a90-4365-9abb-f7ff79fab43e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.891487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1287/2570] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:54:30.898436 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:30.909114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f68d-1b6e-47ed-b6b2-2bda3d40d5c7 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:30.913983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:30.914630 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.914911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.915320 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] PATH_INFO: `/v3/projects/1928ded676f54951aa74009dc0c20c94/users/cdd2bb41488a446db8e9c0f22805c5e0/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.934102 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1928ded676f54951aa74009dc0c20c94, user_id=cdd2bb41488a446db8e9c0f22805c5e0, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:30.938083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:30.951123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:30.956736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1284/2571] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:54:30 2022] PUT /identity/v3/projects/1928ded676f54951aa74009dc0c20c94/users/cdd2bb41488a446db8e9c0f22805c5e0/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:54:30.963440 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:30.963894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:30.964016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:30.983361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:30.984565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:31.044671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1288/2572] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:31.055024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:31.056938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:31.117543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c52b-16eb-4848-b5b5-b0de522bc327 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:31.121301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:31.121916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:31.122191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:31.122459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:31.131547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:31.133008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266c483-51ba-43b2-af4b-533e474572d4 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:31.142348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1285/2573] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:33.600500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:33.615059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377fe4-18d6-4f69-a5df-4226a844a10b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:33.620159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:33.621258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:33.621771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:33.622324 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:33.624827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:33.640384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:33.643301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb43035-850c-4a6e-ae33-fd608943a6a7 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:33.658901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1289/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:33.839943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621084d-4f82-4ac8-aaae-54cb679c5cd0 None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:33.840907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621084d-4f82-4ac8-aaae-54cb679c5cd0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:33.841447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621084d-4f82-4ac8-aaae-54cb679c5cd0 None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:33.843751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1286/2575] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:54:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:54:33.856962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b355-e9c0-4e6f-9504-7ecdf391b1e5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:33.857762 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b355-e9c0-4e6f-9504-7ecdf391b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:33.858239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b355-e9c0-4e6f-9504-7ecdf391b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:33.884818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:33.899769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9883b355-e9c0-4e6f-9504-7ecdf391b1e5 None None] MFA Rules not processed for user `c1015e2218b14b85aba318460f6deb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:33.902390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9883b355-e9c0-4e6f-9504-7ecdf391b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:33.922926 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1290/2576] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:54:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:33.961130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621084d-4f82-4ac8-aaae-54cb679c5cd0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:33.977198 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621084d-4f82-4ac8-aaae-54cb679c5cd0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:33.983985 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:33.984309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:33.984588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:33.984865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:33.996192 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:33.997996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867c5b7-74c1-4567-a685-03e4d618db0e service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:34.023897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1287/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:34.145979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.146263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.147312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] PATH_INFO: `/` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.149140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1291/2578] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:54:34.156704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea26f-767f-4569-b4fe-b73aaba5820d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.157003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea26f-767f-4569-b4fe-b73aaba5820d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.157293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea26f-767f-4569-b4fe-b73aaba5820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.180778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c4bea26f-767f-4569-b4fe-b73aaba5820d None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:34.182065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c4bea26f-767f-4569-b4fe-b73aaba5820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:34.266927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1288/2579] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:54:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:34.278574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:34.282883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:34.311691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a47d-ff61-434a-ba5c-4c56f3f3444d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:34.316279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:34.316835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.317628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.317965 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.335736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:34.337396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974773c7-cc17-411a-9ae6-182123b245a9 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:34.359753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1292/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:34.442091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab629d5-cae7-4556-bc20-6da6bc5a824c None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.442091 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab629d5-cae7-4556-bc20-6da6bc5a824c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.442413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab629d5-cae7-4556-bc20-6da6bc5a824c None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.443924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1289/2581] 10.222.0.13 () {54 vars in 961 bytes} [Tue Aug 30 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:54:34.450718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7713be-fe3b-4420-af82-9f1073ae05e6 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.451067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7713be-fe3b-4420-af82-9f1073ae05e6 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.451453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7713be-fe3b-4420-af82-9f1073ae05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.477276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-be7713be-fe3b-4420-af82-9f1073ae05e6 None None] MFA Rules not processed for user `f34fbf3ab49044968bff90c32f730c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:34.478852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-be7713be-fe3b-4420-af82-9f1073ae05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:34.554261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1293/2582] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Aug 30 11:54:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:34.562129 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab629d5-cae7-4556-bc20-6da6bc5a824c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:34.577649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab629d5-cae7-4556-bc20-6da6bc5a824c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:34.584374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:34.585409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:34.586148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:34.586148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:34.587971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:34.619721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:34.621803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:34.648024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1290/2583] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:35.314380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ee76-e080-4496-8e80-90816d5551b7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:35.315954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ee76-e080-4496-8e80-90816d5551b7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:35.316447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ee76-e080-4496-8e80-90816d5551b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:35.356810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-b631ee76-e080-4496-8e80-90816d5551b7 None None] MFA Rules not processed for user `cdd2bb41488a446db8e9c0f22805c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:35.358692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b631ee76-e080-4496-8e80-90816d5551b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:35.443562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1294/2584] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:35.458515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:35.460515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:35.478093 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4149-f6a3-41cc-ba70-09eed79eef26 service placement] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:35.486339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:35.486984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:35.487262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:35.487536 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:35.497509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:35.499395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:35.510642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1291/2585] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:37.121150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:37.121651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:37.121651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:37.141241 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] MFA Rules not processed for user `cdd2bb41488a446db8e9c0f22805c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:37.142449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:37.150591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1295/2586] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:54:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:41.204235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:41.216845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1042eb-abd1-4c5a-ab28-6946132d5c18 service nova] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:41.225681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:41.226778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:41.227056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:41.227331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:41.229172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:41.239484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:41.240941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913b58-84e2-445f-9286-bc4de37df84f service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:41.249983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1292/2587] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:47.135694 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=70 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:51.060532 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:51.074087 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b021bf-8756-4864-aac9-8864ea39690e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:51.079604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:51.080552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:51.080824 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:51.081283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:51.083030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:51.095852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:51.097628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:51.110119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1296/2588] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:51.246135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=81 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:01.105219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=6 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:10.114943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:10.115467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:10.115467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:10.136938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:10.138196 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:10.203334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1293/2589] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:55:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:10.254988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:10.256673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:10.326657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108326c1-8131-43fd-a272-5eaa2088f375 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:10.332744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:10.333406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:10.333687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:10.333955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:10.343066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:10.344650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:10.353263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1297/2590] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:55:11.075344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:11.077064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:11.100307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816cbf0-c754-47e8-b23b-4ce06203594d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:11.106272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:11.106931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:11.107212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:11.107532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:11.109338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:11.126558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:11.128799 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887fb90-9f52-44b0-b801-93ffb8edd4ca service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:11.140742 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1294/2591] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:20.350193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=32 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:21.135822 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=31 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:23.137067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:23.146862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119285ab-e106-4f10-b0bc-de7179b229bf service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:23.150778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:23.151446 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:23.151630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:23.151896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:23.153773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:23.163562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:23.165002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9538df-0fbd-456f-98de-0fb9b047c94c service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:23.172828 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1298/2592] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:23.305921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:23.306475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:23.306578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] PATH_INFO: `/` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:23.307874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1295/2593] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 11:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:23.312817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2c31-6e50-47ad-8c56-95bed209824e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:23.313951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2c31-6e50-47ad-8c56-95bed209824e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:23.314306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2c31-6e50-47ad-8c56-95bed209824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:23.335023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-edab2c31-6e50-47ad-8c56-95bed209824e None None] MFA Rules not processed for user `51f86708703f4f86953e188c3bac4c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:23.336218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-edab2c31-6e50-47ad-8c56-95bed209824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:23.346606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1299/2594] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 11:55:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:23.358384 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:23.360335 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:23.432803 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb58212-20aa-4811-8ca8-f087fa9be78b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:23.436379 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:23.437016 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:23.437299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:23.437601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:23.448575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:23.450031 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:23.461389 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1296/2595] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:25.748148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0256e-35e3-445e-945d-1e22166bb338 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:25.748689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0256e-35e3-445e-945d-1e22166bb338 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:25.748689 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0256e-35e3-445e-945d-1e22166bb338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:25.767848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-96d0256e-35e3-445e-945d-1e22166bb338 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:25.769091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-96d0256e-35e3-445e-945d-1e22166bb338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:25.776338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1300/2596] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:55:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:25.789462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:25.801234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad56a-163c-42e6-9158-3c58580b6b59 service glance] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:25.806636 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:25.807246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:25.807540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:25.807766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:25.816928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:25.818668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b10b-cf84-483b-bd4a-fb2bb652df3b service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:25.827347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1297/2597] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:55:35.762444 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=12 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:35.823997 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=32 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:39.964139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:39.964692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:39.964692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:39.987413 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] MFA Rules not processed for user `cdd2bb41488a446db8e9c0f22805c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:39.988602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:39.996759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1301/2598] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:55:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:40.755915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:40.756365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:40.756480 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:40.776881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:40.778148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:40.785598 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1298/2599] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:55:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:55:40.798376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:40.810835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502535d-b7bc-42af-a342-38147ebaeb0f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:40.817073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:40.817771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:40.818112 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:40.818442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:40.827338 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:40.829100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:40.838504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1302/2600] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:55:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:55:50.770879 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:50.834784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=9 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:03.750462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:03.752130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:03.770816 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23cfb4-c9ce-47f3-a8ae-1175d1e16c27 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:03.776055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:03.776749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:03.777048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:03.777329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:03.779120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:03.793257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:03.795004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:03.808711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1299/2601] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:06.914665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:06.928643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130ee6-af22-416f-a7dc-340313586272 service swift] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:06.950090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:06.950901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:06.951277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:06.951658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:06.953719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:06.970557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:06.972859 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:06.979069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:06.980748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:06.984517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1303/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:07.003298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcccd7-c4e1-4625-a9a7-8e110b50642e service placement] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:07.011481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:07.012281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:07.012650 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:07.013024 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] PATH_INFO: `/v3/users/d0d69c5d4e5b4475b0b2946502ef51e0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:07.014489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d69c5d4e5b4475b0b2946502ef51e0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:07.016609 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:07.070064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d69c5d4e5b4475b0b2946502ef51e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.083590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d69c5d4e5b4475b0b2946502ef51e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.091245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d69c5d4e5b4475b0b2946502ef51e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.091982 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d69c5d4e5b4475b0b2946502ef51e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.092566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d69c5d4e5b4475b0b2946502ef51e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.109080 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1300/2603] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:56:06 2022] DELETE /identity/v3/users/d0d69c5d4e5b4475b0b2946502ef51e0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:56:07.296723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:07.307870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093afd5-4a41-4aed-8430-c3ecdd2d3349 service placement] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:07.366988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:07.367561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:07.367838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:07.368283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] PATH_INFO: `/v3/projects/7a66a5e6a3224c46b00f6c3518260684` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:07.370202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a66a5e6a3224c46b00f6c3518260684)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:07.372094 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:07.423729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a66a5e6a3224c46b00f6c3518260684', 'request_id': 'req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.431399 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a66a5e6a3224c46b00f6c3518260684', 'request_id': 'req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.442341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a66a5e6a3224c46b00f6c3518260684', 'request_id': 'req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.456576 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] The token cache is being invalidate because project 7a66a5e6a3224c46b00f6c3518260684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:56:07.456929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.457893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.459999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1304/2604] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:56:07 2022] DELETE /identity/v3/projects/7a66a5e6a3224c46b00f6c3518260684 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:56:07.464620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:07.466067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:07.480512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c81c34-acef-4f96-afc7-1530b0b66088 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:07.541414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:07.542056 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:07.542338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:07.542611 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] PATH_INFO: `/v3/users/53bdd586993743b983bf4121925e5f23` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:07.543903 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bdd586993743b983bf4121925e5f23)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:07.545895 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:07.599710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bdd586993743b983bf4121925e5f23'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.611791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:07.614535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bdd586993743b983bf4121925e5f23'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.622750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bdd586993743b983bf4121925e5f23'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.623601 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bdd586993743b983bf4121925e5f23'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.624237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-512cab11-b49f-43e1-b2af-e1c639a1560b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bdd586993743b983bf4121925e5f23'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.639152 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1301/2605] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:56:07 2022] DELETE /identity/v3/users/53bdd586993743b983bf4121925e5f23 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:56:07.817161 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:07.818719 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:07.832159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bc8c6-95b9-433a-9ee8-f2ef569b5d8d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:07.890284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:07.890917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:07.891193 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:07.891469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] PATH_INFO: `/v3/projects/f139931ef99b440e96e4893782978964` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:07.892654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f139931ef99b440e96e4893782978964)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:07.894607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:07.915519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:07.943758 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f139931ef99b440e96e4893782978964', 'request_id': 'req-8e96f56a-d12d-49af-a38a-ff4893b513f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.949815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f139931ef99b440e96e4893782978964', 'request_id': 'req-8e96f56a-d12d-49af-a38a-ff4893b513f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.960064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f139931ef99b440e96e4893782978964', 'request_id': 'req-8e96f56a-d12d-49af-a38a-ff4893b513f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.971445 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] The token cache is being invalidate because project f139931ef99b440e96e4893782978964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:56:07.971736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.972385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-8e96f56a-d12d-49af-a38a-ff4893b513f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:56:07.973922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1305/2606] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:56:07 2022] DELETE /identity/v3/projects/f139931ef99b440e96e4893782978964 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:56:17.635227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:17.968405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:18.839071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472805-c3c6-4156-9921-953f9c78f2da None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:18.839575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472805-c3c6-4156-9921-953f9c78f2da None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:18.839750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472805-c3c6-4156-9921-953f9c78f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:18.861250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f9472805-c3c6-4156-9921-953f9c78f2da None None] MFA Rules not processed for user `cf9d33eff0cc46e2b40011e4c5cd1005`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:18.862454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f9472805-c3c6-4156-9921-953f9c78f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:18.926482 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1302/2607] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:28.914945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=25 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:41.660479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:41.661050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:41.661171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:41.680708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] MFA Rules not processed for user `cdd2bb41488a446db8e9c0f22805c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:41.681934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:41.740671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1306/2608] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:56:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:51.733438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=25 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:23.058685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69bc5-c2a0-4d8d-9e99-c43152929753 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:23.059261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69bc5-c2a0-4d8d-9e99-c43152929753 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:23.059261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69bc5-c2a0-4d8d-9e99-c43152929753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:23.111797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-31d69bc5-c2a0-4d8d-9e99-c43152929753 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:23.113082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-31d69bc5-c2a0-4d8d-9e99-c43152929753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:23.198288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1303/2609] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:23.253253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:23.254784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:23.366117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532344-cfdd-48dc-b01b-e746457d6bc0 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:23.372246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:23.372883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:23.373215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:23.373485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:23.381795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:23.383376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af575edf-9bc1-4d0a-9197-17ba7da1eed9 service swift] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:23.392838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1307/2610] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:57:33.196132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=45 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:33.389141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=47 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:37.445088 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.445669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.445669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.468039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] MFA Rules not processed for user `cdd2bb41488a446db8e9c0f22805c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.469292 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.477343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1304/2611] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.105519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fd2a5-72e8-43cf-808b-96f0829e22ad None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.106078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fd2a5-72e8-43cf-808b-96f0829e22ad None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.106078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fd2a5-72e8-43cf-808b-96f0829e22ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.128210 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-083fd2a5-72e8-43cf-808b-96f0829e22ad None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.129394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-083fd2a5-72e8-43cf-808b-96f0829e22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.137734 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1308/2612] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.150530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.163069 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f131b-90cf-41bd-9ebb-96407b1e110e None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.168622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.169425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.169861 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.170233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.180705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.182767 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.201779 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1305/2613] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:57:49.121375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:49.188458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=9 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:53.778182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.778693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.778693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.800564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] MFA Rules not processed for user `d5525e62e4114ce588a9e0649835442a`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:53.801343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:53.816066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1309/2614] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:53.826941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:53.839929 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739238-fbc2-438d-a78c-060ec090d66e service swift] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:53.844932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e6a60e442924d9e92910b778414a60e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:53.845684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.845962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.846355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.855362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:53.857012 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:53.868554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1306/2615] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 11:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 11:57:57.893826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.895425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:57.996658 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dcfe3-36ca-4890-b82f-dc0a0011d0f5 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:58.002703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:58.003322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:58.003604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:58.003879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:58.005675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:58.018510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:58.020101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:58.030792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1310/2616] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:03.862661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=6 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:08.026573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=46 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:26.508736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:26.510266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:26.606931 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ffd07-3eed-4ef8-b2cc-d1b94ecf435e service swift] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:26.612925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:26.613562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.613843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.614113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.616150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:26.628542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:26.630165 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:26.640859 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1307/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:36.635944 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=41 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:38.444429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.446342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:38.551285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608109b-5134-4c44-9a8a-81ecd8fb9290 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.555854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.556487 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.556764 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.557064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] PATH_INFO: `/v3/users/cf9d33eff0cc46e2b40011e4c5cd1005` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.558190 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9d33eff0cc46e2b40011e4c5cd1005)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.560107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.615989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9d33eff0cc46e2b40011e4c5cd1005'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.631757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9d33eff0cc46e2b40011e4c5cd1005'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.635183 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9d33eff0cc46e2b40011e4c5cd1005'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.635831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9d33eff0cc46e2b40011e4c5cd1005'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.651637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ea10d639-e7b3-40e6-8873-75d2b4cd9388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9d33eff0cc46e2b40011e4c5cd1005'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.659407 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1311/2618] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:38 2022] DELETE /identity/v3/users/cf9d33eff0cc46e2b40011e4c5cd1005 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:38.887603 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.903233 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fee869-a5cb-44da-931d-6cf126cf5677 service placement] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.961338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.961963 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.962238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.962555 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] PATH_INFO: `/v3/projects/e4a1df711400459eb4738809cdcf2760` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.963653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a1df711400459eb4738809cdcf2760)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.965590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.013604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a1df711400459eb4738809cdcf2760', 'request_id': 'req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:39.020066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a1df711400459eb4738809cdcf2760', 'request_id': 'req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:39.026154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a1df711400459eb4738809cdcf2760', 'request_id': 'req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:39.042113 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] The token cache is being invalidate because project e4a1df711400459eb4738809cdcf2760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:39.042437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:39.043120 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-4bebdd0a-b170-4f00-9f24-bec06ec5bed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:39.044659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1308/2619] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:38 2022] DELETE /identity/v3/projects/e4a1df711400459eb4738809cdcf2760 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:39.050014 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.050293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.050558 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.112805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:39.113977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.128611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:39.178206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1312/2620] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:39.186942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.187228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.187503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.208402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:39.209731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.219035 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1309/2621] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:39.223496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.233381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932481-cb2f-428f-b880-37cab8baf9cc None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.241294 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.242209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.242651 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.243074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.244085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:39.244559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.247078 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.264478 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1313/2622] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:39.269076 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.279151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502260a5-ae49-4121-9530-5e57fbb4662f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.285167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.285768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.286044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.286325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.286955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.288928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.320453 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1310/2623] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:39.324732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.335865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48537b1-da59-4bf9-ac10-c892cd52a87c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.396195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.397148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.397625 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.398100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.399182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.402761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.431405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1314/2624] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:39.437241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.448139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8264c1-e5de-4035-ba85-74a4dcfb9d30 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.455126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.456401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.456761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.457144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.458103 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.460587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.473620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1311/2625] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:39.477892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.488778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9211b5-9065-4166-90aa-dafcad5ef868 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.498412 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.499057 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.499339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.499597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.500249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.501900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87987d3-bcdb-4093-aa3f-597729dbbaac admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.513636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1315/2626] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:39.518158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.528550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98957-2d4d-4f29-90ec-310a92591af1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.534640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.535280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.535570 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.535866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] PATH_INFO: `/v3/projects/d4c3962ce8d34616b83a163a067e3c49/users/26286642037a4f8a9e4a22b2dcbfdf89/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.553641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c3962ce8d34616b83a163a067e3c49, user_id=26286642037a4f8a9e4a22b2dcbfdf89, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.556287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.572943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1312/2627] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:39 2022] PUT /identity/v3/projects/d4c3962ce8d34616b83a163a067e3c49/users/26286642037a4f8a9e4a22b2dcbfdf89/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:39.584345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.584632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.584900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.613696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] MFA Rules not processed for user `26286642037a4f8a9e4a22b2dcbfdf89`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:39.614899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.683746 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1316/2628] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:39.695705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.697632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.730834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:39.776090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde040d8-bd73-48fa-bc8f-ccd31b567f9e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.782264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.782884 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.783158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.783426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.797017 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.798637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e12b-e46c-4645-bd72-68c60d87dfc0 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.808397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1313/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:45.089187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.106021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:45.153570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d977b-b402-41b9-821d-fff08971509d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.159844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.160483 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.160761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.161059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] PATH_INFO: `/v3/users/26286642037a4f8a9e4a22b2dcbfdf89` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.162331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26286642037a4f8a9e4a22b2dcbfdf89)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.164267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.217799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26286642037a4f8a9e4a22b2dcbfdf89'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.227254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26286642037a4f8a9e4a22b2dcbfdf89'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.238592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26286642037a4f8a9e4a22b2dcbfdf89'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.239336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26286642037a4f8a9e4a22b2dcbfdf89'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.251600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26286642037a4f8a9e4a22b2dcbfdf89'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.257636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1317/2630] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:45 2022] DELETE /identity/v3/users/26286642037a4f8a9e4a22b2dcbfdf89 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:45.262468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.262956 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.263059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.292171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:45.293424 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.364955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1314/2631] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:45.375332 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.376932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.466986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52432-79d5-4758-bc41-cb8f53b3efd0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.471549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.472179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.472455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.472725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.482825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.484524 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116807-81c2-4bc4-8636-7cad867fb822 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.494461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1318/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:45.779796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.781348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.795486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2065-4006-461c-89c4-b503be364be9 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.801090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.801763 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.802038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.802302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] PATH_INFO: `/v3/projects/d4c3962ce8d34616b83a163a067e3c49` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.803417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c3962ce8d34616b83a163a067e3c49)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.805465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.855140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c3962ce8d34616b83a163a067e3c49', 'request_id': 'req-d06ad0b4-2e45-477e-bbff-54bccd18122b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.861355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c3962ce8d34616b83a163a067e3c49', 'request_id': 'req-d06ad0b4-2e45-477e-bbff-54bccd18122b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.866913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c3962ce8d34616b83a163a067e3c49', 'request_id': 'req-d06ad0b4-2e45-477e-bbff-54bccd18122b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.882221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] The token cache is being invalidate because project d4c3962ce8d34616b83a163a067e3c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:45.882503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.883125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d06ad0b4-2e45-477e-bbff-54bccd18122b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.884622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1315/2633] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:45 2022] DELETE /identity/v3/projects/d4c3962ce8d34616b83a163a067e3c49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:45.891158 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.891447 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.891721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.913387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:45.914635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.927207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:45.978436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1319/2634] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:45.986979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.987262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.987557 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.008488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:46.009739 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.019067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1316/2635] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:46.025047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.040257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcf4ef-5b4d-4e7f-8e91-b0cf2663a30e None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.048117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.048716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.049010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.049279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.049924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:46.050221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.051814 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.063595 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1320/2636] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:46.068106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.078521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35eb8-2c2f-49b6-bc4b-8ad61e681b99 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.084454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.085055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.085355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.085626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.086302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.088262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.119704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1317/2637] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:46.123896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.134850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6ea6-4b5f-48d6-b440-0f696c1deaf0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.191288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.191892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.192169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.192435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.193223 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.195146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.221293 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1321/2638] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:46.225685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.237339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb228-3d84-4db1-8a4e-2d4a61c1e5a4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.242450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.243049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.243344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.243590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.244230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.245858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.247180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:46.260431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1318/2639] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:46.261649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.271791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71952b-ead8-4310-aac9-6c7142fb3045 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.276425 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.277052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.277330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.277596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.278287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.279862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6769e6-65f5-4179-982b-4469de79168b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.292755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1322/2640] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:46.297015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.307566 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a193-cee0-43b7-972d-12f5a659ade1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.313195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.313852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.314128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.314431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] PATH_INFO: `/v3/projects/c248f28397f94c9e8fe231b134ac2812/users/a4f83002d43543ca857d1387c9b56a95/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.330865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c248f28397f94c9e8fe231b134ac2812, user_id=a4f83002d43543ca857d1387c9b56a95, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.333535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.349897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1319/2641] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:46 2022] PUT /identity/v3/projects/c248f28397f94c9e8fe231b134ac2812/users/a4f83002d43543ca857d1387c9b56a95/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:46.361549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.361890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.362166 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.391085 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] MFA Rules not processed for user `a4f83002d43543ca857d1387c9b56a95`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:46.392229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.462056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1323/2642] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:46.466665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.537885 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded918-cf4e-41bc-8ffc-8d2e7df47e62 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.542979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.543597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.543880 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.544209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.544850 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.547079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.587802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1320/2643] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:46.592141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.603058 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86462-9182-435a-9040-41cc2acab5e7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.613163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:46.665943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.666894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.667174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.667471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.668152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.670274 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.695841 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1324/2644] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:46.697260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.708087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78066cef-2363-4ba2-a10b-dca65cc0fbbf admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.712683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.713325 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.713600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.713864 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.714499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.716131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.726994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1321/2645] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:46.731439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.742547 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516f1-d678-4014-bbc4-04c1c55ac643 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.747141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.747830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.748076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.748369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] PATH_INFO: `/v3/projects/049017ca05eb4962846241070418308b/users/ed976c8d83c3436db1c94091a5981b01/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.764618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049017ca05eb4962846241070418308b, user_id=ed976c8d83c3436db1c94091a5981b01, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.768021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.783200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1325/2646] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:46 2022] PUT /identity/v3/projects/049017ca05eb4962846241070418308b/users/ed976c8d83c3436db1c94091a5981b01/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:46.787402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.798889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067d88b-7d1b-4751-93bc-73f829b9275e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.857765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.858419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.858699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.858974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.859706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.861339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73df8af-f24d-4d31-ade0-80b569d38572 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.871759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1322/2647] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:46.875944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.886609 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87bb1-39b2-47f8-a2e8-f985c35dffa3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.891582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.892248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.892557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.892822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] PATH_INFO: `/v3/projects/049017ca05eb4962846241070418308b/users/ed976c8d83c3436db1c94091a5981b01/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.895655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049017ca05eb4962846241070418308b, user_id=ed976c8d83c3436db1c94091a5981b01, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.898353 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.909752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1326/2648] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:46 2022] PUT /identity/v3/projects/049017ca05eb4962846241070418308b/users/ed976c8d83c3436db1c94091a5981b01/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:46.920158 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.920528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.920875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.949920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] MFA Rules not processed for user `ed976c8d83c3436db1c94091a5981b01`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:46.951157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.983089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:47.023628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1323/2649] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:47.037935 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.040250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:47.131927 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3feb2-518b-472c-985d-127348188774 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:47.136647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:47.137427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.137834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.138108 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.148667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:47.150387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fa3d-6873-4a11-a25f-4959b6e7296d service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:47.160873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1327/2650] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:47.297651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.364279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3274302-8d08-4281-a268-30f8b35b90cc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:47.369105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:47.369748 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.370030 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.370415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] PATH_INFO: `/v3/users/a4f83002d43543ca857d1387c9b56a95` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.371544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f83002d43543ca857d1387c9b56a95)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:47.373532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:47.428509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f83002d43543ca857d1387c9b56a95'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:47.445301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f83002d43543ca857d1387c9b56a95'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:47.453427 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f83002d43543ca857d1387c9b56a95'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:47.454454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f83002d43543ca857d1387c9b56a95'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:47.455142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f83002d43543ca857d1387c9b56a95'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:47.478398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1324/2651] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:47 2022] DELETE /identity/v3/users/a4f83002d43543ca857d1387c9b56a95 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:47.483080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.484143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.484143 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.508564 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:47.509941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:47.561187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:47.583950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1328/2652] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:47.591191 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.593515 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:47.651977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:47.658161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9985d-42c0-4684-ae62-f8b9ead0101a admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:47.663272 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:47.664493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.664960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.665507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.675499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:47.676943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:47.686882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1325/2653] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:47.982019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.983786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:47.996431 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2df50-cd80-4fbc-9ee7-16ec9bb45378 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:48.001621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:48.002005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.002279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.002544 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] PATH_INFO: `/v3/projects/c248f28397f94c9e8fe231b134ac2812` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.003669 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c248f28397f94c9e8fe231b134ac2812)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:48.005612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:48.066918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c248f28397f94c9e8fe231b134ac2812', 'request_id': 'req-97e10f36-6aa0-49bd-aa96-5642190a79c4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.072501 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c248f28397f94c9e8fe231b134ac2812', 'request_id': 'req-97e10f36-6aa0-49bd-aa96-5642190a79c4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.082122 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c248f28397f94c9e8fe231b134ac2812', 'request_id': 'req-97e10f36-6aa0-49bd-aa96-5642190a79c4'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.101376 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] The token cache is being invalidate because project c248f28397f94c9e8fe231b134ac2812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:48.101701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.102475 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.106899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1329/2654] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:47 2022] DELETE /identity/v3/projects/c248f28397f94c9e8fe231b134ac2812 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:48.108255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:48.118667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8234d7-eb69-4d22-b061-ae63b0532c2d service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:48.188690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:48.189579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.189971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.191213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] PATH_INFO: `/v3/users/ed976c8d83c3436db1c94091a5981b01` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.191552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed976c8d83c3436db1c94091a5981b01)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:48.193561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:48.249228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed976c8d83c3436db1c94091a5981b01'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.265498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed976c8d83c3436db1c94091a5981b01'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.273511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed976c8d83c3436db1c94091a5981b01'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.274484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed976c8d83c3436db1c94091a5981b01'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.275162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-e01ddd8c-0d11-4b05-beb0-73bd3a0ed0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed976c8d83c3436db1c94091a5981b01'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.295293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1326/2655] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:48 2022] DELETE /identity/v3/users/ed976c8d83c3436db1c94091a5981b01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:48.599120 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:48.600728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:48.615597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10f36-6aa0-49bd-aa96-5642190a79c4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:48.677910 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:48.678674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.679038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.679378 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] PATH_INFO: `/v3/projects/049017ca05eb4962846241070418308b` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.680593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=049017ca05eb4962846241070418308b)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:48.682654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:48.733856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049017ca05eb4962846241070418308b', 'request_id': 'req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.739867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049017ca05eb4962846241070418308b', 'request_id': 'req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.748322 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049017ca05eb4962846241070418308b', 'request_id': 'req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.761179 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] The token cache is being invalidate because project 049017ca05eb4962846241070418308b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:48.761459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.762253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-d5677936-4ccf-43d8-86ee-238a0dcc7d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:48.763747 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1330/2656] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:48 2022] DELETE /identity/v3/projects/049017ca05eb4962846241070418308b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:48.768863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.769457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.769715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.791112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:48.792444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:48.886538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1327/2657] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:48.888614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.888923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.889499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.904879 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:48.930256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:48.931707 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:48.952586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1331/2658] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:48.960258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:48.968731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43dc0-29e4-4812-8e8f-1eabfe3a0b6d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:48.973969 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:48.974693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:48.974971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:48.975241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:48.975918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:48.976254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:48.977900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:48.980604 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:48.993373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1328/2659] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:48.996629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.006151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a18a2-f564-4efd-b1d6-439a7c6166df None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.010861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.011473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.011753 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.012024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.012659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.014631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.043835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1332/2660] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:48 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:49.048081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.058141 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb325c-0c99-4f71-8bc6-d8d57fda12fe admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.116339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.117000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.117357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.117607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.118263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.120227 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.144928 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1329/2661] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:49.150380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.160956 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfcbe7-32f6-4561-8425-cd404078eebf admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.165848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.166449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.166724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.166990 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.167629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.169259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.179319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1333/2662] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:49.183847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.195875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487124e-6b21-408f-8c0d-009604585ad8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.201178 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.201784 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.202059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.202328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.203265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.204911 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d296a-d41a-4930-bc28-cb538aff7e16 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.216230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1330/2663] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:49.220804 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.237488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ec90-aa22-454d-b671-b496474714e3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.251617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.252239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.252520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.252795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] PATH_INFO: `/v3/projects/4ee2ef41f11c4ce8a57b63a6032f0f7a/users/6e0743f9f4094b4ab84f2f25af0299b6/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.272040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee2ef41f11c4ce8a57b63a6032f0f7a, user_id=6e0743f9f4094b4ab84f2f25af0299b6, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.279004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.318537 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1334/2664] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:49 2022] PUT /identity/v3/projects/4ee2ef41f11c4ce8a57b63a6032f0f7a/users/6e0743f9f4094b4ab84f2f25af0299b6/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:49.320876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.321459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.321772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.357576 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] MFA Rules not processed for user `6e0743f9f4094b4ab84f2f25af0299b6`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:49.358795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.437266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1331/2665] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:49.443351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.541909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c8a1-805f-420c-b52d-f488a1797abf admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.548348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.549002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.549231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.549437 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.550888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.552959 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.589640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1335/2666] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:49.594916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.614447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd878-049d-4b91-9673-2f6984959520 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.685602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.686385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.687050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.687050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.687853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.689945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.703475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:49.723412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1332/2667] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:49.727187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.758741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c358-2d2e-40b7-9561-f0411e8d16e2 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.769254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.770167 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.770456 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.770584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.771295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.773061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.786214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1336/2668] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:49.790151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.801230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14ec2-c008-49b9-b522-e8de4fe19385 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.806285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.806942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.807223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.807497 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] PATH_INFO: `/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e/users/57dcf9a1e234499e89f2245347b44c29/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.827547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f16b6926194bf1890e78f3ec1d1d6e, user_id=57dcf9a1e234499e89f2245347b44c29, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.831308 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.848816 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.850970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.852550 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1333/2669] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:49 2022] PUT /identity/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e/users/57dcf9a1e234499e89f2245347b44c29/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:49.856899 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.868938 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11bd5-fa30-404a-a6a5-34b60a2049b0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.921713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ae1a-1589-4b39-b1e6-c9bcde2fa493 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.926689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.927334 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.927615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.927886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.928556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.928673 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.929222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.929502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.929777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] PATH_INFO: `/v3/users/cdd2bb41488a446db8e9c0f22805c5e0` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.930287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.930917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd2bb41488a446db8e9c0f22805c5e0)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.932856 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.941690 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1334/2670] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:49.945705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.949492 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:49.956369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed444-8148-4882-af66-1f13758737b4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.961188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.962074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.962421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.962744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] PATH_INFO: `/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e/users/57dcf9a1e234499e89f2245347b44c29/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.964922 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f16b6926194bf1890e78f3ec1d1d6e, user_id=57dcf9a1e234499e89f2245347b44c29, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.967950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a33dd5-372a-48c7-a412-4a2271108985 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.979385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1335/2671] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:49 2022] PUT /identity/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e/users/57dcf9a1e234499e89f2245347b44c29/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:49.989983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.990433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.990558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.996115 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd2bb41488a446db8e9c0f22805c5e0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.006750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd2bb41488a446db8e9c0f22805c5e0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.014003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd2bb41488a446db8e9c0f22805c5e0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.014629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd2bb41488a446db8e9c0f22805c5e0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.020461 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] MFA Rules not processed for user `57dcf9a1e234499e89f2245347b44c29`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.021754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.027191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd2bb41488a446db8e9c0f22805c5e0'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.033482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1337/2672] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:49 2022] DELETE /identity/v3/users/cdd2bb41488a446db8e9c0f22805c5e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:50.101712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1336/2673] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:50.109070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.110560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.169568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320fd9-d46f-4c27-a201-951679e25e9e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.173655 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.174280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.174555 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.174827 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.214107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.215535 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.240850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.242889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.253334 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1338/2674] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:50.266395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:50.292294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d6d47-49e9-4908-9df9-c6b09f4f17bc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.339513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.348666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e86b-6730-4408-ac40-9aabfd70a9d6 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.351090 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.351756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.352032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.352302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] PATH_INFO: `/v3/projects/1928ded676f54951aa74009dc0c20c94` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.352477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.353113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.353390 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.353543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1928ded676f54951aa74009dc0c20c94)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.353659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.355352 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.355464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.398984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:50.403460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1928ded676f54951aa74009dc0c20c94', 'request_id': 'req-97866faa-2733-4b17-aeca-edbf418b986b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.410465 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1928ded676f54951aa74009dc0c20c94', 'request_id': 'req-97866faa-2733-4b17-aeca-edbf418b986b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.416135 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1928ded676f54951aa74009dc0c20c94', 'request_id': 'req-97866faa-2733-4b17-aeca-edbf418b986b'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.419250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.420702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45624fa-c066-4ee4-976a-099acfb76da9 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.429713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] The token cache is being invalidate because project 1928ded676f54951aa74009dc0c20c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:50.430003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.430516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1339/2675] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:50.432322 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-97866faa-2733-4b17-aeca-edbf418b986b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.433844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1337/2676] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:50 2022] DELETE /identity/v3/projects/1928ded676f54951aa74009dc0c20c94 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:50.439054 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.439343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.439599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.459599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.460837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.525947 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1340/2677] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:50.534208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.534546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.534826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.557679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.558889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.567835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1338/2678] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:50.572145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.583421 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d31fb-b397-4610-805e-e88d4442fa7d None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.588659 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.589327 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.589606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.589889 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.590629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:50.590934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.592667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.606319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1341/2679] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:50.610007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.619835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9465-404f-46be-ac87-4eed6e957227 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.624590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.625286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.625582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.625835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.626473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.628409 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.660213 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1339/2680] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:50.664786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.675614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452038-de9b-4275-8806-43f58da331a8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.735146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.735853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.736025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.736306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.736936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.738899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.761196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1342/2681] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:50.765367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.777407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb10b3-993b-4a7f-b855-62f7873956e3 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.783122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.783746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.784022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.784284 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.785006 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.786653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.798374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1340/2682] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:50.802354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.812629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f1b8-a40b-4285-90d8-231cb5565573 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.817370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.818408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.818408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.818614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.819156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.820760 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b9177-16c5-4764-97da-fb849a91a5dc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.832375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1343/2683] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:50.836996 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.848079 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ccae-4eeb-4a83-b97e-9b0fd370973b admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.854174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.854844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.855123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.855398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] PATH_INFO: `/v3/projects/e7497249e4064eb3addc63a56a1ef1e2/users/a7641898af58445d9b80766804ff20f5/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.871211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7497249e4064eb3addc63a56a1ef1e2, user_id=a7641898af58445d9b80766804ff20f5, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.874255 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.889977 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1341/2684] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:50 2022] PUT /identity/v3/projects/e7497249e4064eb3addc63a56a1ef1e2/users/a7641898af58445d9b80766804ff20f5/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:50.900366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.900773 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.901077 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.929679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] MFA Rules not processed for user `a7641898af58445d9b80766804ff20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.930894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.970613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.003714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1344/2685] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:51.008402 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.022043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.073753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aebb0-1f6e-4731-bf65-6973dea11d61 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.078559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.079160 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.079434 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.079699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.080665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.082616 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.111643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1342/2686] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.115930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.127276 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49038ea4-229c-462a-bbbb-4c1909869511 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.182502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.183088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.183366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.183634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.184263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.186197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.210139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1345/2687] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:51.214226 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.225344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043817-f29f-4d5f-a5cc-352e044e22ca admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.230621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.231234 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.231513 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.231773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.232419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.234077 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.246230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1343/2688] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.250774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.261084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb20e1-52b0-4b39-b927-9efa6ed37109 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.266387 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.267048 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.267329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.267611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] PATH_INFO: `/v3/projects/d37cec3b335b4217a76cf50136a92f14/users/c92fa40fd8514dcb9ba87ec8ea10adb7/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.284459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37cec3b335b4217a76cf50136a92f14, user_id=c92fa40fd8514dcb9ba87ec8ea10adb7, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.287521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.308568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1346/2689] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:51 2022] PUT /identity/v3/projects/d37cec3b335b4217a76cf50136a92f14/users/c92fa40fd8514dcb9ba87ec8ea10adb7/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:51.315668 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.331867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0d74-c0c2-40b1-828f-7e3401c84113 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.390244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.390851 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.391172 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.391521 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.392193 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.393838 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6aa28-888b-440b-a1ba-34e33e452777 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.403588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1344/2690] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.408126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.418820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1658a-bfc9-4fc3-a9ce-003b39fa70c5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.423982 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.424628 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.424901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.425196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] PATH_INFO: `/v3/projects/d37cec3b335b4217a76cf50136a92f14/users/c92fa40fd8514dcb9ba87ec8ea10adb7/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.427182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37cec3b335b4217a76cf50136a92f14, user_id=c92fa40fd8514dcb9ba87ec8ea10adb7, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.429835 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.440170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1347/2691] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:51 2022] PUT /identity/v3/projects/d37cec3b335b4217a76cf50136a92f14/users/c92fa40fd8514dcb9ba87ec8ea10adb7/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:51.452623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.452938 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.453326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.484578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] MFA Rules not processed for user `c92fa40fd8514dcb9ba87ec8ea10adb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.486167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.558010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1345/2692] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.574715 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.577930 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.641176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525e41d-10c0-4886-a3d9-6b7d489bd00c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.644995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.645614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.645887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.646152 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.655215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.656808 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc78804-f547-4db5-ad96-53bbe2fd70ea service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.666130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1348/2693] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:52.069005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.077913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.136025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf9e1-dcd8-4ae7-973b-78246d665e9b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.141316 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.141957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.142235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.142508 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] PATH_INFO: `/v3/users/a7641898af58445d9b80766804ff20f5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.143768 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7641898af58445d9b80766804ff20f5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.145765 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.196075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7641898af58445d9b80766804ff20f5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.208475 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7641898af58445d9b80766804ff20f5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.215216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7641898af58445d9b80766804ff20f5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.215912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7641898af58445d9b80766804ff20f5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.216519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7641898af58445d9b80766804ff20f5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.234545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1346/2694] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:52 2022] DELETE /identity/v3/users/a7641898af58445d9b80766804ff20f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.240215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.240733 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.240861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.263932 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:52.265181 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.292134 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.327309 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1349/2695] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:52.339507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.341081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.408064 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bc84-b88f-48cf-be7e-6c13c772600c admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.412240 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.412847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.413175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.413447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.423267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.424694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.434245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1347/2696] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:52.714331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.715913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.728428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c2eee-3879-4f53-acba-1e495c546796 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.734059 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.734727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.735118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.735402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] PATH_INFO: `/v3/projects/e7497249e4064eb3addc63a56a1ef1e2` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.736909 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7497249e4064eb3addc63a56a1ef1e2)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.738830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.788568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7497249e4064eb3addc63a56a1ef1e2', 'request_id': 'req-17767ddc-dd35-4db4-8f7b-f596a3a4a098'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.794004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7497249e4064eb3addc63a56a1ef1e2', 'request_id': 'req-17767ddc-dd35-4db4-8f7b-f596a3a4a098'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.804266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7497249e4064eb3addc63a56a1ef1e2', 'request_id': 'req-17767ddc-dd35-4db4-8f7b-f596a3a4a098'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.816408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] The token cache is being invalidate because project e7497249e4064eb3addc63a56a1ef1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:52.816695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.817402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.818972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1350/2697] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:52 2022] DELETE /identity/v3/projects/e7497249e4064eb3addc63a56a1ef1e2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.823238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.834097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93465c-868c-4b79-aa97-5750d47030a9 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.862096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.894440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.895082 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.895348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.895619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] PATH_INFO: `/v3/users/c92fa40fd8514dcb9ba87ec8ea10adb7` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.896751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92fa40fd8514dcb9ba87ec8ea10adb7)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.898720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.948131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92fa40fd8514dcb9ba87ec8ea10adb7'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.960808 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92fa40fd8514dcb9ba87ec8ea10adb7'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.967843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92fa40fd8514dcb9ba87ec8ea10adb7'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.968511 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92fa40fd8514dcb9ba87ec8ea10adb7'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.969149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d660cfcb-7ccc-4b8e-8c9f-b20ffe31e5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92fa40fd8514dcb9ba87ec8ea10adb7'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.983814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1348/2698] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:52 2022] DELETE /identity/v3/users/c92fa40fd8514dcb9ba87ec8ea10adb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:53.270943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.272539 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.290815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767ddc-dd35-4db4-8f7b-f596a3a4a098 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.348472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.349215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.349493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.349765 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] PATH_INFO: `/v3/projects/d37cec3b335b4217a76cf50136a92f14` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.350881 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37cec3b335b4217a76cf50136a92f14)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.352790 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.402674 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37cec3b335b4217a76cf50136a92f14', 'request_id': 'req-575625b1-8aa4-46a8-b752-58bf471503ca'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.408023 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.409574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37cec3b335b4217a76cf50136a92f14', 'request_id': 'req-575625b1-8aa4-46a8-b752-58bf471503ca'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.420546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37cec3b335b4217a76cf50136a92f14', 'request_id': 'req-575625b1-8aa4-46a8-b752-58bf471503ca'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.432653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] The token cache is being invalidate because project d37cec3b335b4217a76cf50136a92f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:53.432936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.433619 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-575625b1-8aa4-46a8-b752-58bf471503ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.435106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1351/2699] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:53 2022] DELETE /identity/v3/projects/d37cec3b335b4217a76cf50136a92f14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.440286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.440756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.440877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.461223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.462406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.522821 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1349/2700] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:53.530921 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.531282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.531592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.552528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.553775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.563222 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1352/2701] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:53.567843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.578367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89cdc-eb52-4427-965d-21504f7acaf2 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.583858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.584483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.584760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.585061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.585708 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:53.586007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.587600 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.599773 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1350/2702] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:53.604722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.616905 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c933f-26f7-4c8d-a828-8088eccf318c None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.622893 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.623493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.623771 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.624033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.624691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.626785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.659195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1353/2703] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:53.663736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.674746 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72625-f51e-42f8-9c44-4aabc83631cc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.708669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.736265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.736783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.737095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.737371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.738000 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.739921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.766212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1351/2704] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:53.770985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.785602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f59e5-5583-4101-b6ba-e2048f981b59 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.791484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.792088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.792366 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.792632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.793297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.794902 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.805631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1354/2705] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:53.809877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.820707 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd5c9d-4539-4f3e-8772-1b43e1c1e503 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.825789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.826393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.826669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.826936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.827579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.829244 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d676d-dca2-43ef-a456-c420ed6ba8ac admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.840579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1352/2706] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:53.845354 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.856699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38215-a204-40dc-aa24-e1eb992d1757 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.862319 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.862975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.863258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.863534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] PATH_INFO: `/v3/projects/b02f4faab37e47d2b6c8eadfa4a65cae/users/abd951cff7914f91bee8b78091e25444/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.879831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02f4faab37e47d2b6c8eadfa4a65cae, user_id=abd951cff7914f91bee8b78091e25444, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.884284 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.905988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1355/2707] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:53 2022] PUT /identity/v3/projects/b02f4faab37e47d2b6c8eadfa4a65cae/users/abd951cff7914f91bee8b78091e25444/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.916831 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.917153 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.917435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.945741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] MFA Rules not processed for user `abd951cff7914f91bee8b78091e25444`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.946949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.015040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1353/2708] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:54.019778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.083718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fc7d-526f-4ece-a3c7-d9d28224cc73 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.089430 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.090041 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.090305 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.090570 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.091196 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.093104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.123110 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1356/2709] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:54 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:54.127593 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.138720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37febf5f-0027-4d43-947e-444e9d24cb9d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.197715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.198382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.198663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.199323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.199573 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.201662 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.225212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1354/2710] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:54 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:54.229550 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.240416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da639e3-b135-4609-ba2b-f222e7cb2490 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.245646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.246220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.246518 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.246784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.247418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.249279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.261050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1357/2711] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:54.265626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.276184 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f4d37-781c-4ed7-896f-cf4443095007 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.281492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.282421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.282421 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.282683 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] PATH_INFO: `/v3/projects/24525dcc6bc44b27af928014f822833b/users/3036d761eab0466696b2d915cce39a58/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.298368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24525dcc6bc44b27af928014f822833b, user_id=3036d761eab0466696b2d915cce39a58, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.301073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.321984 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1355/2712] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:54 2022] PUT /identity/v3/projects/24525dcc6bc44b27af928014f822833b/users/3036d761eab0466696b2d915cce39a58/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:54.326267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.338228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7cc9-47d1-8f15-c574d0db360c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.394991 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:54.402117 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.403119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.403607 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.403888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.404681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.407369 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d908-aa22-41cf-a85a-1c5d110b3011 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.419591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1358/2713] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:54.424179 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.435170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f58c5-e766-452b-a2b7-40d1a10557bd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.440567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.441246 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.441548 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.441814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] PATH_INFO: `/v3/projects/24525dcc6bc44b27af928014f822833b/users/3036d761eab0466696b2d915cce39a58/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.443710 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=24525dcc6bc44b27af928014f822833b, user_id=3036d761eab0466696b2d915cce39a58, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.446359 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.449632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:54.458414 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1356/2714] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:54 2022] PUT /identity/v3/projects/24525dcc6bc44b27af928014f822833b/users/3036d761eab0466696b2d915cce39a58/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:54.470069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.470209 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.470553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.503575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] MFA Rules not processed for user `3036d761eab0466696b2d915cce39a58`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:54.504799 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.578627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1359/2715] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:54.586888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.588995 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.648954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba44bf-bccf-4c51-9544-b65c09d4cdbc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.652842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.653486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.653766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.654037 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.664412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.666131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1602a8f-fdb7-44a8-8671-4a7ba9192cbc service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.678089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1357/2716] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:54.759821 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.853959 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d2e59-8404-4aa8-895e-f09d590b8cd3 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.858559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.859200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.859476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.859750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] PATH_INFO: `/v3/users/abd951cff7914f91bee8b78091e25444` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.861791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd951cff7914f91bee8b78091e25444)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.863874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.918972 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd951cff7914f91bee8b78091e25444'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.926591 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd951cff7914f91bee8b78091e25444'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.937460 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd951cff7914f91bee8b78091e25444'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.938637 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd951cff7914f91bee8b78091e25444'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.951257 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:54.952682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd951cff7914f91bee8b78091e25444'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.960685 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1360/2717] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/users/abd951cff7914f91bee8b78091e25444 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:54.966122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.966413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.966682 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.986015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:54.987254 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.044230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1358/2718] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:55.055690 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.057526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.116761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ebf84-2181-47dc-b116-5d7f37996ef9 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.121224 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.121948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.122279 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.122549 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.133668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.135142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.144845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1361/2719] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:55.418730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.420237 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.433249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858b9f8-7bce-4214-9ec2-8ea1aadd8b68 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.438927 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.439569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.439827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.440105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] PATH_INFO: `/v3/projects/b02f4faab37e47d2b6c8eadfa4a65cae` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.441382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02f4faab37e47d2b6c8eadfa4a65cae)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.443332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.492771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02f4faab37e47d2b6c8eadfa4a65cae', 'request_id': 'req-8625cb3d-7844-4565-a60f-9cb13a456dd5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.499066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02f4faab37e47d2b6c8eadfa4a65cae', 'request_id': 'req-8625cb3d-7844-4565-a60f-9cb13a456dd5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.505365 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02f4faab37e47d2b6c8eadfa4a65cae', 'request_id': 'req-8625cb3d-7844-4565-a60f-9cb13a456dd5'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.520304 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] The token cache is being invalidate because project b02f4faab37e47d2b6c8eadfa4a65cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:55.520619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.521283 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.522901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1359/2720] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/projects/b02f4faab37e47d2b6c8eadfa4a65cae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.527003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.536784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a619-9ba3-4bc0-af40-2f8089faba2c service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.595819 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.596394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.596677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.596941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] PATH_INFO: `/v3/users/3036d761eab0466696b2d915cce39a58` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.598137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3036d761eab0466696b2d915cce39a58)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.600137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.657513 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3036d761eab0466696b2d915cce39a58'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.667592 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3036d761eab0466696b2d915cce39a58'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.674875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3036d761eab0466696b2d915cce39a58'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.675521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3036d761eab0466696b2d915cce39a58'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.687610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-241869bb-d3dc-4480-93a8-0948e3abe84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3036d761eab0466696b2d915cce39a58'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.693770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1362/2721] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/users/3036d761eab0466696b2d915cce39a58 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.975127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.976807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.990807 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625cb3d-7844-4565-a60f-9cb13a456dd5 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.028009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.074125 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.074762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.075036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.075305 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] PATH_INFO: `/v3/projects/24525dcc6bc44b27af928014f822833b` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.076582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=24525dcc6bc44b27af928014f822833b)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.078620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.128268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24525dcc6bc44b27af928014f822833b', 'request_id': 'req-666d3c3d-1cff-495e-af86-8eac642d98cf'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.135725 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24525dcc6bc44b27af928014f822833b', 'request_id': 'req-666d3c3d-1cff-495e-af86-8eac642d98cf'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.141759 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24525dcc6bc44b27af928014f822833b', 'request_id': 'req-666d3c3d-1cff-495e-af86-8eac642d98cf'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.156070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] The token cache is being invalidate because project 24525dcc6bc44b27af928014f822833b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:56.156364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.157085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-666d3c3d-1cff-495e-af86-8eac642d98cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.158735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1360/2722] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/projects/24525dcc6bc44b27af928014f822833b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:56.170780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.171165 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.171517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.193129 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.194360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.208311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.280636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1363/2723] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.291989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.292407 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.293949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.320382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.322798 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.335955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1361/2724] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.340890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.354676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ff8ca-ec37-46e7-a936-7cffe6a40c82 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.361195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.361842 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.362116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.363752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.363752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:56.363752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.365174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.379929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1364/2725] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:56.385348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.396935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe47fa-6c71-4604-b5a9-aaa961567efc None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.401449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.402071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.402492 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.402855 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.403926 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.406370 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.440127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1362/2726] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.444073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.456504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff9c5d-84d7-42b1-8ff4-6c12bd3c797c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.520686 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.521337 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.521605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.521874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.522521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.524443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.558980 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1365/2727] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.566362 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.578275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98a20-cafa-4c6b-9aab-9c24490d8dfb admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.583877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.584491 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.584795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.585115 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.585766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.587374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.598137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1363/2728] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.602641 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.613526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3403c8b-a6dc-486e-be83-0e9aa742b0a8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.618907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.619520 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.619798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.620072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.620702 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.622345 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baf0f6-393a-4197-b3e8-856bfef8213e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.635486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1366/2729] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.639877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.651740 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4d79-4d18-4bf5-bc42-f717dafbb1a9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.656772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.657578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.657860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.658143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] PATH_INFO: `/v3/projects/e9718f712cdf497abadf5d3b3a3a113d/users/5dc2d837aecb46b4816a59c594f28fc6/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.675876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9718f712cdf497abadf5d3b3a3a113d, user_id=5dc2d837aecb46b4816a59c594f28fc6, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.678606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.693964 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1364/2730] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:56 2022] PUT /identity/v3/projects/e9718f712cdf497abadf5d3b3a3a113d/users/5dc2d837aecb46b4816a59c594f28fc6/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:56.705888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.706142 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.706436 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.735099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] MFA Rules not processed for user `5dc2d837aecb46b4816a59c594f28fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.736526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.812617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1367/2731] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.819136 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.882961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.901625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac37fae-98ef-40e1-8115-06d47aef3397 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.906815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.907667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.908661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.910229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.910582 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.912510 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.947556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1365/2732] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.952952 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.968028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf13b1-c25b-44e8-8b2a-bb35a7183dd7 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.982640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.060051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.061176 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.061688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.062082 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.063125 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.065523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.095855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1368/2733] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:57.100309 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.111526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0c9c-08f6-4232-8465-36ed2df806f4 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.118558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.119391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.119716 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.120066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.120955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.123014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.139176 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1366/2734] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:57.144325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.155359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294b2b-1205-4e9f-8efe-26a54ee78947 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.160917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.161602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.161882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.162174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] PATH_INFO: `/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5/users/3842df3d6ed64477b3c3f0091a6ba3e2/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.178559 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452d4ce9f6334cbf89e98d7e53a4d2d5, user_id=3842df3d6ed64477b3c3f0091a6ba3e2, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.181234 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.196569 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1369/2735] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:57 2022] PUT /identity/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5/users/3842df3d6ed64477b3c3f0091a6ba3e2/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:57.200657 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.211627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8870-2f0d-44ae-8516-0913b6af9816 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.272354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.273032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.273346 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.273623 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.274273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.275877 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207c26-4564-4406-bfcd-bd8dd8e47ceb admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.287818 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1367/2736] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:57.292000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.302384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba151a5-c54e-426b-b8a9-c33ad3011733 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.307664 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.308408 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.308751 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.309118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] PATH_INFO: `/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5/users/3842df3d6ed64477b3c3f0091a6ba3e2/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.311258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452d4ce9f6334cbf89e98d7e53a4d2d5, user_id=3842df3d6ed64477b3c3f0091a6ba3e2, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.314329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.326033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1370/2737] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:57 2022] PUT /identity/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5/users/3842df3d6ed64477b3c3f0091a6ba3e2/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:57.337743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.338028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.338302 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.355640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.357572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.370151 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] MFA Rules not processed for user `3842df3d6ed64477b3c3f0091a6ba3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.371355 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.424629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa5f8-f6db-42a3-bcac-810554f80de2 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.429657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.430316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.430688 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.430970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] PATH_INFO: `/v3/users/6e0743f9f4094b4ab84f2f25af0299b6` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.432259 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0743f9f4094b4ab84f2f25af0299b6)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.434341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.451701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1368/2738] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:57.464886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.466684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.489381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0743f9f4094b4ab84f2f25af0299b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:57.501289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0743f9f4094b4ab84f2f25af0299b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:57.509573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0743f9f4094b4ab84f2f25af0299b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:57.510347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0743f9f4094b4ab84f2f25af0299b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:57.515056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.519621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.525384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-5ef9a4b4-e304-4c29-b16a-e6fdf5979376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0743f9f4094b4ab84f2f25af0299b6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:57.532177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1371/2739] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:57 2022] DELETE /identity/v3/users/6e0743f9f4094b4ab84f2f25af0299b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:57.533319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39153c-ea3c-484a-a2d2-20bda6993bda None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.536671 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.536960 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.537269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.556028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.557271 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.584138 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.584925 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.585367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.585644 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.587625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.616920 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1372/2740] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:57.627300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.628924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.651512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.652994 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.663457 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1369/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:57.686650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85fe3-4f90-4f37-928d-a17a3d0be0b8 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.690731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.691361 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.691634 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.691900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.701298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.702720 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.713127 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1373/2742] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:57.768701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.770385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.783307 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0c38a-7dde-472c-932d-23249da09d85 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.787934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.788579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.788866 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.789166 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.791410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.853173 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.854622 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.864437 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1370/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:57.994822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.996954 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.019035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f2ff-6e86-407f-89f9-4399b09d1703 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.024826 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.025458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.025743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.026033 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] PATH_INFO: `/v3/projects/4ee2ef41f11c4ce8a57b63a6032f0f7a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.027203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee2ef41f11c4ce8a57b63a6032f0f7a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.029523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.081022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee2ef41f11c4ce8a57b63a6032f0f7a', 'request_id': 'req-fb97eee0-185c-4af4-aec1-f43558c535d3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.087008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee2ef41f11c4ce8a57b63a6032f0f7a', 'request_id': 'req-fb97eee0-185c-4af4-aec1-f43558c535d3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.096164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee2ef41f11c4ce8a57b63a6032f0f7a', 'request_id': 'req-fb97eee0-185c-4af4-aec1-f43558c535d3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.107999 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] The token cache is being invalidate because project 4ee2ef41f11c4ce8a57b63a6032f0f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:58.108291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.108929 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.110752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1374/2744] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:57 2022] DELETE /identity/v3/projects/4ee2ef41f11c4ce8a57b63a6032f0f7a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.115104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.133063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80f914-d357-4884-847c-8bb4f248ecb6 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.186495 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:58.199133 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.199777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.200055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.200332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] PATH_INFO: `/v3/users/57dcf9a1e234499e89f2245347b44c29` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.201474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57dcf9a1e234499e89f2245347b44c29)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.203428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.253888 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dcf9a1e234499e89f2245347b44c29'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.265530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dcf9a1e234499e89f2245347b44c29'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.272543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dcf9a1e234499e89f2245347b44c29'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.273277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dcf9a1e234499e89f2245347b44c29'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.273941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-31a3e9cb-adb1-4b73-a91b-8aca51a6511a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dcf9a1e234499e89f2245347b44c29'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.288893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1371/2745] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:58 2022] DELETE /identity/v3/users/57dcf9a1e234499e89f2245347b44c29 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.571710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.573593 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.588359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97eee0-185c-4af4-aec1-f43558c535d3 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.597086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:58.656415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.657239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.657600 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.657912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] PATH_INFO: `/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.660075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f16b6926194bf1890e78f3ec1d1d6e)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.662915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.716253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f16b6926194bf1890e78f3ec1d1d6e', 'request_id': 'req-19d67e1e-20be-4959-83eb-75dc55ad4710'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.722098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f16b6926194bf1890e78f3ec1d1d6e', 'request_id': 'req-19d67e1e-20be-4959-83eb-75dc55ad4710'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.731458 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f16b6926194bf1890e78f3ec1d1d6e', 'request_id': 'req-19d67e1e-20be-4959-83eb-75dc55ad4710'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.743328 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] The token cache is being invalidate because project 58f16b6926194bf1890e78f3ec1d1d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:58.743615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.744313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-19d67e1e-20be-4959-83eb-75dc55ad4710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.745933 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1375/2746] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:58 2022] DELETE /identity/v3/projects/58f16b6926194bf1890e78f3ec1d1d6e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.751156 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.751621 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.751730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.773909 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:58.775171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.837829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1372/2747] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:58.904684 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.904925 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.905267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.927128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:58.928317 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.937718 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1376/2748] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:58.942391 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.952789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6353f63-78d2-457d-8b81-f42498fd1b28 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.959478 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.960083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.960352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.960618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.961298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:58.961592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.963231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.975544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1373/2749] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:58.979806 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.989381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f72ca2-7ff7-4667-b08c-08945d157d42 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.994438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.995056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.995336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.995608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.996245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.998192 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.029500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1377/2750] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.034036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.044083 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15559c15-b4ac-47b2-8e5c-9e79493d9304 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.093150 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.100857 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.101528 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.102081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.102509 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.103162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.105086 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.129007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1374/2751] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.133119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.143695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ea88e-a18e-4eca-8598-de48f84cd052 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.149136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.149744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.150021 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.150290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.150963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.152534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.162917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1378/2752] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:59.167050 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.177364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4d0a-1b5d-4ab5-9b47-df6189c948d1 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.182504 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.183099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.183380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.183653 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.184300 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.185949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70377-6e0c-46fa-803c-f012f55a7044 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.197046 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1375/2753] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:59.201311 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.211792 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92744-246a-42a7-8bcc-0a0f2d4bb4da admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.216785 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.217472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.217749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.218015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] PATH_INFO: `/v3/projects/21e03d53c0234e75afae97ada6d444bd/users/54ef393ad0bb41ca8a4f3367249d2e2a/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.234620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e03d53c0234e75afae97ada6d444bd, user_id=54ef393ad0bb41ca8a4f3367249d2e2a, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.237649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.253289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1379/2754] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:59 2022] PUT /identity/v3/projects/21e03d53c0234e75afae97ada6d444bd/users/54ef393ad0bb41ca8a4f3367249d2e2a/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:59.263729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.264015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.264288 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.297232 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] MFA Rules not processed for user `54ef393ad0bb41ca8a4f3367249d2e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.298545 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.367907 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1376/2755] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:59.372356 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.419019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.448203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db1a44-2eec-4eba-8491-7820a4fa68ea admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.453744 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.454381 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.454662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.454950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.456015 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.457974 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.486562 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1380/2756] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.491464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.503367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d0852-b37f-44b5-8baa-51f10d4bf1bb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.567269 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.568134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.568531 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.568936 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.569988 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.572945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.604075 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1377/2757] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.608304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.619472 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd7d1-8cac-451a-8677-da56ee65edb4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.624589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.625269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.625545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.625836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.626473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.628362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.639620 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1381/2758] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:59.644063 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.654846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b3f54-52ff-4069-b42a-5d92d4d8682d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.661112 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.661729 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.662021 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.662289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.662919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.664596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d808955-1c8e-4b14-b0ac-221e338c7af8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.675677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1378/2759] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:59.679963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.690036 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d36dd4-027a-4be7-a7ea-349ca486363d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.695786 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.696443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.696724 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.697010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] PATH_INFO: `/v3/projects/2769004e8e3e4b218386a5eb4752cdeb/users/d191ab37719d4fc6b6b09ee845ec41d1/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.713435 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2769004e8e3e4b218386a5eb4752cdeb, user_id=d191ab37719d4fc6b6b09ee845ec41d1, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.716178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.732287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1382/2760] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:59 2022] PUT /identity/v3/projects/2769004e8e3e4b218386a5eb4752cdeb/users/d191ab37719d4fc6b6b09ee845ec41d1/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:59.742881 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.743106 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.743374 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.782667 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] MFA Rules not processed for user `d191ab37719d4fc6b6b09ee845ec41d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.784324 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.822098 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.857949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1379/2761] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:59.862640 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.926725 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71e39-24a7-447f-a132-7d2699f18bd1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.932409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.933002 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.933308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.933575 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.934200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.936091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.968258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1383/2762] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.973775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.985652 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcff68-1ce4-40d6-8ab5-a99e08678dea None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.042032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.042642 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.042916 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.043190 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.043806 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.045777 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.070442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1380/2763] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:00.074729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.086630 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505510-562d-4360-94ef-8543ce1e7137 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.092543 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.093191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.093469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.093741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.094403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.096231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.107948 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1384/2764] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:00.112277 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.126685 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ab73-79c5-4a1a-89bf-3fd399a4931e admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.131935 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.132590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.132869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.133170 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] PATH_INFO: `/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270/users/5061c040d6a142c7b0a074cce87c7fe2/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.148912 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51237ba2fd3745c3ad3baa75d5a5f270, user_id=5061c040d6a142c7b0a074cce87c7fe2, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.151588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.167592 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1381/2765] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:00 2022] PUT /identity/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270/users/5061c040d6a142c7b0a074cce87c7fe2/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:00.171701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.181831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638e2c-3635-4d15-904d-6a6aa945ca76 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.239493 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.240098 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.240370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.240638 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.241306 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.242896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc13ace-a9d1-4543-b5f8-1f2b7d6d1339 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.245246 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:00.253736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1385/2766] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:00.258280 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.272419 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119066c-af0f-47ed-99cb-e8d2fc731877 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.277762 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.278420 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.278695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.278968 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] PATH_INFO: `/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270/users/5061c040d6a142c7b0a074cce87c7fe2/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.280900 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51237ba2fd3745c3ad3baa75d5a5f270, user_id=5061c040d6a142c7b0a074cce87c7fe2, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.283591 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.294447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1382/2767] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:00 2022] PUT /identity/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270/users/5061c040d6a142c7b0a074cce87c7fe2/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:00.307491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.307986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.308479 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.344846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] MFA Rules not processed for user `5061c040d6a142c7b0a074cce87c7fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:00.346409 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.440005 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1386/2768] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:00.451313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.453447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.480118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.481660 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.524606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48eda-6ce9-4e58-830e-c52348f76868 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.528446 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.529085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.529364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.529634 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.539124 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.540571 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdbbf3-03f7-4eb4-834d-6992df527d5b service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.549900 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29580f3f-5992-4050-9e45-af43d67f6e20 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.550247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1383/2769] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:00.555631 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.556428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.556848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.557263 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] PATH_INFO: `/v3/users/5dc2d837aecb46b4816a59c594f28fc6` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.558605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc2d837aecb46b4816a59c594f28fc6)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.560608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.611886 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc2d837aecb46b4816a59c594f28fc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.620333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc2d837aecb46b4816a59c594f28fc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.629145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc2d837aecb46b4816a59c594f28fc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.629962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc2d837aecb46b4816a59c594f28fc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.644278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc2d837aecb46b4816a59c594f28fc6'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.650510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1387/2770] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:00 2022] DELETE /identity/v3/users/5dc2d837aecb46b4816a59c594f28fc6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:00.655189 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.655476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.655751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.676062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:00.677440 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.699071 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:00.743961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1384/2771] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:00.753553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.755175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.761301 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:00.821652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75b9ed-da19-48f8-b0a7-5767c4336085 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.825363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.825977 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.826250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.826516 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.836187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.837657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.847287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1388/2772] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:01.080829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.082543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.129526 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.131419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.146854 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b16a-be48-4a96-aa21-7b2edbf459eb service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.148438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca249-ae8b-46bf-9945-90737665a22d None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.152289 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.152743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.152896 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.153416 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.153692 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.153819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.153963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] PATH_INFO: `/v3/projects/e9718f712cdf497abadf5d3b3a3a113d` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.154073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.155396 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9718f712cdf497abadf5d3b3a3a113d)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.156641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.157561 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.206066 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9718f712cdf497abadf5d3b3a3a113d', 'request_id': 'req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.211571 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9718f712cdf497abadf5d3b3a3a113d', 'request_id': 'req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.219607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.219871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9718f712cdf497abadf5d3b3a3a113d', 'request_id': 'req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.221180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.230626 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1385/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:01.232449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] The token cache is being invalidate because project e9718f712cdf497abadf5d3b3a3a113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:01.232743 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.233403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.234877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1389/2774] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:01 2022] DELETE /identity/v3/projects/e9718f712cdf497abadf5d3b3a3a113d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:01.239070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.249735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6e348-868d-425e-924a-8643d508fcdd service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.307941 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.308561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.308849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.309188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] PATH_INFO: `/v3/users/3842df3d6ed64477b3c3f0091a6ba3e2` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.310386 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3842df3d6ed64477b3c3f0091a6ba3e2)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.312318 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.336679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:01.363469 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3842df3d6ed64477b3c3f0091a6ba3e2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.376793 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3842df3d6ed64477b3c3f0091a6ba3e2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.384084 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3842df3d6ed64477b3c3f0091a6ba3e2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.389290 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3842df3d6ed64477b3c3f0091a6ba3e2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.390020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-2ea5f90b-1d8b-4c49-b962-4ccc3683c326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3842df3d6ed64477b3c3f0091a6ba3e2'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.404397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1386/2775] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:01 2022] DELETE /identity/v3/users/3842df3d6ed64477b3c3f0091a6ba3e2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:01.698405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.700011 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.714877 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ebd8c-96fd-45a7-acf7-5440bcc7fdd8 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.784090 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.784783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.785046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.785336 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] PATH_INFO: `/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.786527 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=452d4ce9f6334cbf89e98d7e53a4d2d5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.788643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.825566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:01.839781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452d4ce9f6334cbf89e98d7e53a4d2d5', 'request_id': 'req-01960adb-af99-48c9-9b41-fe50a7408f7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.845162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452d4ce9f6334cbf89e98d7e53a4d2d5', 'request_id': 'req-01960adb-af99-48c9-9b41-fe50a7408f7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.854735 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452d4ce9f6334cbf89e98d7e53a4d2d5', 'request_id': 'req-01960adb-af99-48c9-9b41-fe50a7408f7b'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.866185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] The token cache is being invalidate because project 452d4ce9f6334cbf89e98d7e53a4d2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:01.866471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.867103 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-01960adb-af99-48c9-9b41-fe50a7408f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.868611 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1390/2776] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:01 2022] DELETE /identity/v3/projects/452d4ce9f6334cbf89e98d7e53a4d2d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:01.873778 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.874068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.874343 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.898351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:01.899781 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.971814 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1387/2777] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:01.984207 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.984500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.984834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.011525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:02.012732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.022457 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1391/2778] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:02.026753 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.037332 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea3b93-6cd0-4bce-b59e-10baa3ed36d0 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.042854 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.043464 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.043747 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.044029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.044660 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:02.044962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.046638 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.059144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1388/2779] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:02.063579 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.073272 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f487c-786d-4d68-8c88-e82c388e20b4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.079150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.079748 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.080029 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.080290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.081449 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.083341 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.120295 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1392/2780] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:02.124426 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.135410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d592e-7e48-4d51-8e02-997e024808f0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.193633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.194268 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.194547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.194819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.195441 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.197417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.227357 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1389/2781] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:02.234131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.245897 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90552-d52a-4227-b0de-7bacc9f10e56 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.251270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.251872 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.252141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.252406 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.253076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.254672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.264951 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1393/2782] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:02.269066 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.279684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1353-98c2-4d45-9b56-0fedbd085ead admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.284731 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.285356 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.285633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.285905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.286540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.288114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b665eb5-2b5f-40a7-beb5-df61e5decab0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.298754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1390/2783] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:02.302970 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.313653 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dceee-2a42-47d1-882c-ce27921adbc1 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.319051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.319713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.320009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.320273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] PATH_INFO: `/v3/projects/3d7d728f65204ea1ba90149ead4bfd53/users/5fa4555919f44f00ba9d3e408df737f3/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.336119 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7d728f65204ea1ba90149ead4bfd53, user_id=5fa4555919f44f00ba9d3e408df737f3, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.338778 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.353845 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1394/2784] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:02 2022] PUT /identity/v3/projects/3d7d728f65204ea1ba90149ead4bfd53/users/5fa4555919f44f00ba9d3e408df737f3/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:02.424756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.425005 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.425252 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.443562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:02.465558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] MFA Rules not processed for user `5fa4555919f44f00ba9d3e408df737f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:02.466791 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.537684 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1391/2785] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:02.542517 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.608055 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0861d82-f82b-415e-b6f3-062987476319 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.613064 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.613661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.613937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.614202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.614833 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.616716 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.646768 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1395/2786] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:02.651858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.663267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24db25-8e19-45ce-a6be-de39b4b7a53b None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.742425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.743068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.743350 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.743613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.744271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.746338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.771540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1392/2787] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:02.775943 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.787266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb876f-56f8-444a-8646-f05eb3173a07 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.793229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.793888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.794145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.794433 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.795056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.796649 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.808815 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1396/2788] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:02.812820 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.823486 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e057c2-8fe5-4ca0-9972-1516798692cd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.828278 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.828930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.829231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.829527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] PATH_INFO: `/v3/projects/4a39c39cbfff4af59bde5e38966dc69c/users/c817644c2b824fb7afb2f27cd8095f33/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.844568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39c39cbfff4af59bde5e38966dc69c, user_id=c817644c2b824fb7afb2f27cd8095f33, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.847663 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.863266 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1393/2789] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:02 2022] PUT /identity/v3/projects/4a39c39cbfff4af59bde5e38966dc69c/users/c817644c2b824fb7afb2f27cd8095f33/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:02.867632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.878769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a7dec-f552-4d5d-b949-155477087e85 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.908299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:02.942652 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.943534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.943936 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.944402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.945091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.946717 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66521da3-5019-478d-a974-8df921ff9e3c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.957776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1397/2790] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:02.962336 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.973065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645496-e1ea-4c00-b33f-091b771b7a6f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.978790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.979444 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.979719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.979983 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] PATH_INFO: `/v3/projects/4a39c39cbfff4af59bde5e38966dc69c/users/c817644c2b824fb7afb2f27cd8095f33/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.982197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39c39cbfff4af59bde5e38966dc69c, user_id=c817644c2b824fb7afb2f27cd8095f33, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.984824 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.996180 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1394/2791] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:02 2022] PUT /identity/v3/projects/4a39c39cbfff4af59bde5e38966dc69c/users/c817644c2b824fb7afb2f27cd8095f33/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:03.006997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:03.007282 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:03.007551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:03.041139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] MFA Rules not processed for user `c817644c2b824fb7afb2f27cd8095f33`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:03.042375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:03.122916 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1398/2792] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:03.134691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:03.136764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:03.193393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:03.199476 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd091c-ab69-4cdc-9e71-5c72f22bc4ac admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:03.206556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:03.207174 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:03.207462 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:03.207743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:03.273229 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:03.274673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:03.284562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1395/2793] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:05.340187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.350721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4fa80-e2b6-479f-80ef-58c669a8c044 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.354911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.355509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.355784 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.356050 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.358046 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.419106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.420574 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.429636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1399/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:07.579242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.588717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc83c-0330-4cc9-938b-a4dfbdf30a4c service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.592569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.593301 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.593665 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.594009 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.600477 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.602141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.604397 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.605889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcac26-5ce3-413c-a05b-bbfc116fb6ba service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.616962 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1396/2795] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:07.654578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:07.671584 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0ffe-7e3e-4624-a2bb-84a6712be016 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.676126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.676918 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.677291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.677563 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] PATH_INFO: `/v3/users/54ef393ad0bb41ca8a4f3367249d2e2a` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.678723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ef393ad0bb41ca8a4f3367249d2e2a)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.680749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.728374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ef393ad0bb41ca8a4f3367249d2e2a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.735834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ef393ad0bb41ca8a4f3367249d2e2a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.743602 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ef393ad0bb41ca8a4f3367249d2e2a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.744270 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ef393ad0bb41ca8a4f3367249d2e2a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.757070 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ef393ad0bb41ca8a4f3367249d2e2a'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.763721 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1400/2796] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:07 2022] DELETE /identity/v3/users/54ef393ad0bb41ca8a4f3367249d2e2a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:07.768645 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.768934 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.769239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.788869 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:07.790132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.856588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1397/2797] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:07.863971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.865728 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.933145 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c17f6-4550-4749-9778-6843660ed506 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.936761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.937414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.937691 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.937962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.947427 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.948861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.958589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1401/2798] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:08.243699 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.245206 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:08.259447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c7b6-ab72-4526-b6bc-d4409f312f06 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.264823 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.265520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.265800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.266097 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] PATH_INFO: `/v3/projects/21e03d53c0234e75afae97ada6d444bd` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.267238 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e03d53c0234e75afae97ada6d444bd)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.269249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.319221 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e03d53c0234e75afae97ada6d444bd', 'request_id': 'req-d5f2beb1-4e7f-4085-b786-58dc88a6067f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.325450 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e03d53c0234e75afae97ada6d444bd', 'request_id': 'req-d5f2beb1-4e7f-4085-b786-58dc88a6067f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.332015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e03d53c0234e75afae97ada6d444bd', 'request_id': 'req-d5f2beb1-4e7f-4085-b786-58dc88a6067f'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.345530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] The token cache is being invalidate because project 21e03d53c0234e75afae97ada6d444bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:08.345819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.346489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.348062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1398/2799] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:08 2022] DELETE /identity/v3/projects/21e03d53c0234e75afae97ada6d444bd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:08.352429 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.362184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2cdd-5763-4a68-8c71-511bfbeae894 service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.421069 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.421647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.421917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.422186 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] PATH_INFO: `/v3/users/d191ab37719d4fc6b6b09ee845ec41d1` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.423403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d191ab37719d4fc6b6b09ee845ec41d1)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.425374 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.442086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:08.489088 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd191ab37719d4fc6b6b09ee845ec41d1'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.503016 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd191ab37719d4fc6b6b09ee845ec41d1'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.510523 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd191ab37719d4fc6b6b09ee845ec41d1'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.511264 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd191ab37719d4fc6b6b09ee845ec41d1'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.523605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd191ab37719d4fc6b6b09ee845ec41d1'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.530028 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1402/2800] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:08 2022] DELETE /identity/v3/users/d191ab37719d4fc6b6b09ee845ec41d1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:08.812092 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.813843 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:08.838045 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2beb1-4e7f-4085-b786-58dc88a6067f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.848306 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:08.899466 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.900101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.900376 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.900628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] PATH_INFO: `/v3/projects/2769004e8e3e4b218386a5eb4752cdeb` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.901802 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2769004e8e3e4b218386a5eb4752cdeb)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.903715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.953648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2769004e8e3e4b218386a5eb4752cdeb', 'request_id': 'req-7bf3d226-4f69-4f06-9582-3a32af7c95e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.961287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2769004e8e3e4b218386a5eb4752cdeb', 'request_id': 'req-7bf3d226-4f69-4f06-9582-3a32af7c95e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.968026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2769004e8e3e4b218386a5eb4752cdeb', 'request_id': 'req-7bf3d226-4f69-4f06-9582-3a32af7c95e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.982161 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] The token cache is being invalidate because project 2769004e8e3e4b218386a5eb4752cdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:08.982458 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.983139 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.984704 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1399/2801] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:08 2022] DELETE /identity/v3/projects/2769004e8e3e4b218386a5eb4752cdeb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:08.988844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.990348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.003787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8f57-f426-4bc1-aa2e-c2ca69981649 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.062018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.062656 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.062931 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.063202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] PATH_INFO: `/v3/users/5061c040d6a142c7b0a074cce87c7fe2` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.064315 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5061c040d6a142c7b0a074cce87c7fe2)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.066326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.116752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5061c040d6a142c7b0a074cce87c7fe2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.127710 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5061c040d6a142c7b0a074cce87c7fe2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.137741 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5061c040d6a142c7b0a074cce87c7fe2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.138471 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5061c040d6a142c7b0a074cce87c7fe2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.152079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-23cb50a7-d605-41cc-adb8-fab8fe6ffba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5061c040d6a142c7b0a074cce87c7fe2'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.158582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1403/2802] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:08 2022] DELETE /identity/v3/users/5061c040d6a142c7b0a074cce87c7fe2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:09.439479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.441048 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.454043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d226-4f69-4f06-9582-3a32af7c95e0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.513766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.514399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.514677 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.514945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] PATH_INFO: `/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.516096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51237ba2fd3745c3ad3baa75d5a5f270)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.518065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.565096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:09.568010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51237ba2fd3745c3ad3baa75d5a5f270', 'request_id': 'req-00551dc5-a27a-433d-b840-1957021fbf9d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.574588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51237ba2fd3745c3ad3baa75d5a5f270', 'request_id': 'req-00551dc5-a27a-433d-b840-1957021fbf9d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.581695 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51237ba2fd3745c3ad3baa75d5a5f270', 'request_id': 'req-00551dc5-a27a-433d-b840-1957021fbf9d'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.599345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] The token cache is being invalidate because project 51237ba2fd3745c3ad3baa75d5a5f270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:09.599654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.600889 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-00551dc5-a27a-433d-b840-1957021fbf9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:09.602549 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1400/2803] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:09 2022] DELETE /identity/v3/projects/51237ba2fd3745c3ad3baa75d5a5f270 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:09.611966 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.612380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.612738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.640325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:09.641578 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.646342 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:09.708182 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1404/2804] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:09.716646 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.716950 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.717261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.738544 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:09.739750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.748770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1401/2805] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:09.753923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.765148 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0bb3-5811-4073-a4aa-50602ec3007b None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.771855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.772722 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.773068 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.773394 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.774403 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:09.774777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.777298 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.792890 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1405/2806] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:09.797783 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.811932 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee558aa1-f1e0-4c87-96d0-8c950125bd4c None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.818512 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.819215 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.819625 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.819906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.820556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.822554 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.858231 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1402/2807] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:09 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:09.862880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.873287 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497517d-1bdd-4413-9aa2-deb0615bc99b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.931252 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.931865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.932146 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.932415 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.933107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.935019 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.958892 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1406/2808] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:09 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:09.963099 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.973860 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c670c3-c17c-41a4-bcaf-c306c3fcf621 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.979755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.980364 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.980633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.980901 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.981587 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.983205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.993607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1403/2809] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:09.999291 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.015750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b0b4d-c5a2-496f-8b97-e3bdcb20164e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.022217 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.022844 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.023133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.023404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.024044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.025759 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ab8fe-b9a2-49a6-abd7-292358f22970 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.037304 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1407/2810] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:10.042273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.063643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d6c64-4577-4a95-b17d-d64faa4a80da admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.070286 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.070951 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.071228 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.071505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] PATH_INFO: `/v3/projects/7d683d400f834a0eb45dbf33f8eb8ae3/users/b2dcd1f98f7940f4b153400ff26450e0/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.088882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d683d400f834a0eb45dbf33f8eb8ae3, user_id=b2dcd1f98f7940f4b153400ff26450e0, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.091719 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.107216 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1404/2811] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:10 2022] PUT /identity/v3/projects/7d683d400f834a0eb45dbf33f8eb8ae3/users/b2dcd1f98f7940f4b153400ff26450e0/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:10.120130 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.120453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.120749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.149385 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] MFA Rules not processed for user `b2dcd1f98f7940f4b153400ff26450e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:10.150610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:10.216261 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1408/2812] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:10.228223 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.230104 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:10.292341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe540f-d6d7-4d5a-b507-def72ad1f914 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.296331 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.297085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.297341 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.297613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.308241 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.309713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948535-2dfa-47b4-8b08-871d77195f0c service glance] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.319632 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1405/2813] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:12.553139 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.554873 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.562010 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:12.627380 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606e6e8-a76a-4064-83d3-fd5ba80e4b08 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.632650 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.633333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.633610 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.633874 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] PATH_INFO: `/v3/users/5fa4555919f44f00ba9d3e408df737f3` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.635073 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa4555919f44f00ba9d3e408df737f3)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.637162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.690397 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa4555919f44f00ba9d3e408df737f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:12.699598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa4555919f44f00ba9d3e408df737f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:12.707661 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa4555919f44f00ba9d3e408df737f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:12.708362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa4555919f44f00ba9d3e408df737f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:12.720443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa4555919f44f00ba9d3e408df737f3'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:12.727202 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1409/2814] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:12 2022] DELETE /identity/v3/users/5fa4555919f44f00ba9d3e408df737f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:12.732459 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.733007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.733137 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.754029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:12.755455 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.820552 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1406/2815] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:12.831237 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.832761 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.899643 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3a2f-c073-45f6-b95b-4725178f189c admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.905030 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.905876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.906204 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.906482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.916597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.918299 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.928572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1410/2816] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:13.225208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:13.226674 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:13.239431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87991fc-b5d3-4570-958d-18f828c8c573 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:13.249607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:13.250273 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:13.250553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:13.250826 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] PATH_INFO: `/v3/projects/3d7d728f65204ea1ba90149ead4bfd53` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:13.251998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7d728f65204ea1ba90149ead4bfd53)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:13.253955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:13.263028 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:13.305679 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7d728f65204ea1ba90149ead4bfd53', 'request_id': 'req-208635f3-1b06-4d3e-b3e0-921e7011faa0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.312126 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7d728f65204ea1ba90149ead4bfd53', 'request_id': 'req-208635f3-1b06-4d3e-b3e0-921e7011faa0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.317520 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7d728f65204ea1ba90149ead4bfd53', 'request_id': 'req-208635f3-1b06-4d3e-b3e0-921e7011faa0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.334276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] The token cache is being invalidate because project 3d7d728f65204ea1ba90149ead4bfd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:13.334568 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.335338 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.336952 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1407/2817] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:13 2022] DELETE /identity/v3/projects/3d7d728f65204ea1ba90149ead4bfd53 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:13.341525 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:13.354107 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359e68-9322-4419-9dab-0952e6f149bd service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:13.379791 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:13.416105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:13.416749 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:13.417086 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:13.417363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] PATH_INFO: `/v3/users/c817644c2b824fb7afb2f27cd8095f33` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:13.418586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c817644c2b824fb7afb2f27cd8095f33)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:13.420510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:13.482529 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c817644c2b824fb7afb2f27cd8095f33'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.491565 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c817644c2b824fb7afb2f27cd8095f33'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.499423 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c817644c2b824fb7afb2f27cd8095f33'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.500116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c817644c2b824fb7afb2f27cd8095f33'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.512455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-a11ba9f3-5c37-417e-ac87-a60052f0a9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c817644c2b824fb7afb2f27cd8095f33'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.518401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1411/2818] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:13 2022] DELETE /identity/v3/users/c817644c2b824fb7afb2f27cd8095f33 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:13.816019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:13.817727 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:13.840498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208635f3-1b06-4d3e-b3e0-921e7011faa0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:13.900921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:13.901786 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:13.902073 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:13.902353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] PATH_INFO: `/v3/projects/4a39c39cbfff4af59bde5e38966dc69c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:13.903538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a39c39cbfff4af59bde5e38966dc69c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:13.905639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:13.958714 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a39c39cbfff4af59bde5e38966dc69c', 'request_id': 'req-14479238-65c6-42b0-a88e-93fbda4db1ac'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.967780 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a39c39cbfff4af59bde5e38966dc69c', 'request_id': 'req-14479238-65c6-42b0-a88e-93fbda4db1ac'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.973643 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a39c39cbfff4af59bde5e38966dc69c', 'request_id': 'req-14479238-65c6-42b0-a88e-93fbda4db1ac'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.987403 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] The token cache is being invalidate because project 4a39c39cbfff4af59bde5e38966dc69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:13.987735 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.988452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-14479238-65c6-42b0-a88e-93fbda4db1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:13.990578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1408/2819] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:13 2022] DELETE /identity/v3/projects/4a39c39cbfff4af59bde5e38966dc69c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:13.997789 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:13.998348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:13.998469 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.024622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:14.025924 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:14.095220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1412/2820] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:14.104405 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.105628 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.105920 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.128918 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:14.130348 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:14.140372 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1409/2821] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:14.144989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.155615 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7ee4b-68ae-4fef-b5a6-88a8d08375b4 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.161770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.162359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.162642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.163025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.163723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:14.164040 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.165714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.179203 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1413/2822] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:14.184020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.194059 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ad339-8ccc-40e8-9371-bc7b121ddac6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.200281 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.200933 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.201235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.201505 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.202144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.204132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.227038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:14.252840 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1410/2823] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:14.258941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.273950 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c379b-9894-4b8c-95d3-3d135866561e admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.312606 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:14.342862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.343500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.343776 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.344045 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.344677 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.346622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.371443 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1414/2824] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:14.375651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.386532 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7220-c701-4360-9c17-f1d0350da860 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.391537 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.392159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.392438 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.392717 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.393404 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.395049 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.406081 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1411/2825] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:14.410247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.421360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499427f-4f1e-4e15-a0bf-60cdde84ef43 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.426184 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.426837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.427121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.427388 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.428035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.429708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ebd5c-ec93-485e-86d2-d1a6855c3ee0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.441313 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1415/2826] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:14.445862 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.457018 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c60f1-fa79-44b6-ba16-4bb6359ea8dc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.461987 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.462641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.462915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.463185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] PATH_INFO: `/v3/projects/d09619992b494a6c8373b2d36ecbe0b5/users/5597d10621d843169825f63f45b48358/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.480330 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09619992b494a6c8373b2d36ecbe0b5, user_id=5597d10621d843169825f63f45b48358, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.483259 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.501910 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1412/2827] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:14 2022] PUT /identity/v3/projects/d09619992b494a6c8373b2d36ecbe0b5/users/5597d10621d843169825f63f45b48358/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:14.514438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.514723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.515000 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.546213 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] MFA Rules not processed for user `5597d10621d843169825f63f45b48358`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:14.547441 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:14.622774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1416/2828] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:14.627449 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.700326 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577fa3-a16f-47e8-bdd9-7823bb0eaa03 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.705800 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.706418 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.706715 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.706966 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.707597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.709559 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.740072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1413/2829] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:14.744414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.756473 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33e333-9f17-4564-a1c0-5187f5839dcc None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.822215 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.822830 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.823106 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.823506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.824163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.826109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.849499 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1417/2830] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:14.853741 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.864460 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8e1e-234c-4f11-b46f-1bd5f0c28291 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.870745 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.871425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.871706 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.871971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.872627 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.874293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.885701 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1414/2831] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:14.890370 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.900654 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a166e-de98-4bae-add1-68a9b69b4adc admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.905693 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.906308 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.906583 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.906850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.907504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.909140 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778e56b-7f07-4c54-9aa8-8d99f428b426 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.920056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1418/2832] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:14.924578 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:14.935443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b9ed0-5b2d-4624-accc-ba520b9e06e9 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:14.940892 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:14.942105 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.942586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.943038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] PATH_INFO: `/v3/projects/8f1d74e2920c4c16b5f544262787bfd3/users/d6898f4811bc49f4a8a6818475015ce4/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:14.960612 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1d74e2920c4c16b5f544262787bfd3, user_id=d6898f4811bc49f4a8a6818475015ce4, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:14.963845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:14.981380 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1415/2833] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:14 2022] PUT /identity/v3/projects/8f1d74e2920c4c16b5f544262787bfd3/users/d6898f4811bc49f4a8a6818475015ce4/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:14.992266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:14.992553 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:14.992822 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.022008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] MFA Rules not processed for user `d6898f4811bc49f4a8a6818475015ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:15.023218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.032359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:15.096218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1419/2834] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:15.101542 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.178249 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726dc1-bb76-4206-be15-f074167f93f0 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.184368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.185001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.185299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.185569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.186212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.188154 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.198845 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:15.221942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1416/2835] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:15 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:15.227008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.240116 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61302-5970-4dc0-875c-a6b973a5d464 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.302200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.302813 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.303084 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.303343 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.304008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.306022 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.330039 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1420/2836] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:15 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:15.334726 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.345883 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf1022-60bc-4f90-a5f0-130b36d4dbb8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.351971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.352620 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.352960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.353298 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.353957 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.355553 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.366540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1417/2837] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:15.371177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.381812 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76747ae-74d3-4a33-80d8-ac6b9278eed0 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.388896 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.389871 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.390187 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.390510 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] PATH_INFO: `/v3/projects/323f36403e7c4699b95a67053290adf9/users/7be8e06da03b453c88db9f5749f14c9a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.409635 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323f36403e7c4699b95a67053290adf9, user_id=7be8e06da03b453c88db9f5749f14c9a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.412303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.427491 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1421/2838] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:15 2022] PUT /identity/v3/projects/323f36403e7c4699b95a67053290adf9/users/7be8e06da03b453c88db9f5749f14c9a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:15.432065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.443354 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dbdb-a14a-40de-9364-fb08538b4f04 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.505114 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.505730 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.506007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.506279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.506955 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.508562 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f13da-e7e6-4208-a96f-71afff412668 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.518890 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1418/2839] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:15.524083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.539359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ecb4-aca0-4b64-9f82-1ea148a5a353 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.546535 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.547666 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.548092 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.548861 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] PATH_INFO: `/v3/projects/323f36403e7c4699b95a67053290adf9/users/7be8e06da03b453c88db9f5749f14c9a/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.551984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=323f36403e7c4699b95a67053290adf9, user_id=7be8e06da03b453c88db9f5749f14c9a, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.556359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.569955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1422/2840] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:15 2022] PUT /identity/v3/projects/323f36403e7c4699b95a67053290adf9/users/7be8e06da03b453c88db9f5749f14c9a/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:15.584271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.584540 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.584809 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.618796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] MFA Rules not processed for user `7be8e06da03b453c88db9f5749f14c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:15.620001 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.693159 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1419/2841] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:15.705703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.707632 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.768326 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fafd3f-f59f-4144-8c7a-930b2e624f7b admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.772678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.773402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.773599 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.773901 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.787883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:15.836858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.838363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.848131 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1423/2842] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:17.414560 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.425543 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5de91-a4f7-4d44-815a-e3b96945b8cf None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.430760 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.431398 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.431680 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.431946 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.491829 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.495796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.500062 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:17.505514 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1420/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:18.085242 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.097923 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe4f-e6d8-4fef-b73f-9702073a6801 service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.102214 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.102837 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.103126 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.103398 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.113448 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.114876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3765e-115f-4627-86cb-7e7c3b1770da service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.125975 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1424/2844] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:22.076572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:22.148817 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ee1f-9609-49b4-b116-25ede0bd65b5 service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:22.154144 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:22.154769 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:22.155070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:22.155435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] PATH_INFO: `/v3/users/5597d10621d843169825f63f45b48358` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:22.156648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5597d10621d843169825f63f45b48358)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:22.158606 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:22.208547 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5597d10621d843169825f63f45b48358'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.220010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5597d10621d843169825f63f45b48358'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.226847 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5597d10621d843169825f63f45b48358'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.227561 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5597d10621d843169825f63f45b48358'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.228210 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5597d10621d843169825f63f45b48358'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.242556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1421/2845] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:22 2022] DELETE /identity/v3/users/5597d10621d843169825f63f45b48358 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:22.247200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:22.247713 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:22.247820 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:22.268727 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:22.269922 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:22.335836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1425/2846] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:22.346483 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:22.348258 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:22.412260 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bd730-b727-4566-a6c3-9d9e4ce6492f admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:22.416736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:22.417319 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:22.417428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:22.417681 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:22.428065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:22.429556 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:22.439473 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1422/2847] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:22.712402 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:22.714025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:22.731962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6faaca-ea22-4f64-a115-b86f75b94296 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:22.738670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:22.739219 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:22.739503 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:22.739770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] PATH_INFO: `/v3/projects/d09619992b494a6c8373b2d36ecbe0b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:22.740915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09619992b494a6c8373b2d36ecbe0b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:22.742880 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:22.792405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09619992b494a6c8373b2d36ecbe0b5', 'request_id': 'req-80f637e6-e890-4d9f-badf-e3d540d9c7cf'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.798534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09619992b494a6c8373b2d36ecbe0b5', 'request_id': 'req-80f637e6-e890-4d9f-badf-e3d540d9c7cf'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.807377 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09619992b494a6c8373b2d36ecbe0b5', 'request_id': 'req-80f637e6-e890-4d9f-badf-e3d540d9c7cf'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.820052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] The token cache is being invalidate because project d09619992b494a6c8373b2d36ecbe0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:22.820339 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.821089 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.822706 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1426/2848] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:22 2022] DELETE /identity/v3/projects/d09619992b494a6c8373b2d36ecbe0b5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:22.827539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:22.837761 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df0d40-4532-4f7d-9d2f-79b267a0df40 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:22.856264 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:22.900265 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:22.900897 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:22.901208 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:22.901499 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] PATH_INFO: `/v3/users/d6898f4811bc49f4a8a6818475015ce4` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:22.902619 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6898f4811bc49f4a8a6818475015ce4)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:22.904723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:22.952998 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6898f4811bc49f4a8a6818475015ce4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.966070 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6898f4811bc49f4a8a6818475015ce4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.973131 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6898f4811bc49f4a8a6818475015ce4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.973795 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6898f4811bc49f4a8a6818475015ce4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.974399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6898f4811bc49f4a8a6818475015ce4'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:22.989169 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1423/2849] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:22 2022] DELETE /identity/v3/users/d6898f4811bc49f4a8a6818475015ce4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:23.267221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:23.268876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:23.284453 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f637e6-e890-4d9f-badf-e3d540d9c7cf admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:23.311506 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:23.346285 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:23.346846 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:23.347128 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:23.347404 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] PATH_INFO: `/v3/projects/8f1d74e2920c4c16b5f544262787bfd3` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:23.348572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1d74e2920c4c16b5f544262787bfd3)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:23.350512 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:23.404220 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1d74e2920c4c16b5f544262787bfd3', 'request_id': 'req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.410568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1d74e2920c4c16b5f544262787bfd3', 'request_id': 'req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.422150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1d74e2920c4c16b5f544262787bfd3', 'request_id': 'req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.433596 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] The token cache is being invalidate because project 8f1d74e2920c4c16b5f544262787bfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:23.433883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.434552 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.436060 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1427/2850] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:23 2022] DELETE /identity/v3/projects/8f1d74e2920c4c16b5f544262787bfd3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:23.440428 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:23.441882 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:23.454721 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3f0a-5df8-4a4a-9a79-80df0cfc3b00 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:23.516442 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:23.517127 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:23.517413 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:23.517689 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] PATH_INFO: `/v3/users/7be8e06da03b453c88db9f5749f14c9a` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:23.518819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be8e06da03b453c88db9f5749f14c9a)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:23.520953 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:23.571393 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:23.581602 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be8e06da03b453c88db9f5749f14c9a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.596551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be8e06da03b453c88db9f5749f14c9a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.603723 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be8e06da03b453c88db9f5749f14c9a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.604519 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be8e06da03b453c88db9f5749f14c9a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.605201 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-32447575-0564-4541-9927-38d0bd8f08d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be8e06da03b453c88db9f5749f14c9a'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:23.622412 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1424/2851] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:23 2022] DELETE /identity/v3/users/7be8e06da03b453c88db9f5749f14c9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:23.920136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:23.922013 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:23.935884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb26ea3-6abd-4bbe-b874-b9a1c35ef4dd admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.004348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.005008 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.005292 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.005568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] PATH_INFO: `/v3/projects/323f36403e7c4699b95a67053290adf9` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.006855 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] RBAC: Authorizing `identity:delete_project(project_id=323f36403e7c4699b95a67053290adf9)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.008780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.057834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323f36403e7c4699b95a67053290adf9', 'request_id': 'req-57d6290e-49ce-4af1-8d7c-d9125b54058c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.063738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323f36403e7c4699b95a67053290adf9', 'request_id': 'req-57d6290e-49ce-4af1-8d7c-d9125b54058c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.065461 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:24.074485 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323f36403e7c4699b95a67053290adf9', 'request_id': 'req-57d6290e-49ce-4af1-8d7c-d9125b54058c'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.087883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] The token cache is being invalidate because project 323f36403e7c4699b95a67053290adf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:24.088169 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.088853 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-57d6290e-49ce-4af1-8d7c-d9125b54058c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.090466 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1428/2852] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:23 2022] DELETE /identity/v3/projects/323f36403e7c4699b95a67053290adf9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:24.095744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.096029 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.096297 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.116040 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:24.117188 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:24.176812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1425/2853] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:24.185256 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.185541 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.185795 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.208598 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:24.209934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:24.221302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1429/2854] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:24.227569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.237454 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1639dba-83e9-4798-bb7e-aefc788bbaeb None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.242247 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.242853 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.243128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.243395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] PATH_INFO: `/v3/domains` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.244061 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:24.244358 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.245980 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.257366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1426/2855] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:24.261636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.271883 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39657a-b012-4035-9799-67ed9441ef78 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.277097 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.277701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.277986 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.278273 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.278904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.281414 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.312769 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1430/2856] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:24.316999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.327065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5618b-e8b6-4379-b912-b4690ea78104 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.393157 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.393654 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.393930 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.394218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] PATH_INFO: `/v3/users` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.394815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.396733 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.418720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1427/2857] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:24.423283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.433781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332638-73b1-4d82-97bd-6e031a24fbe4 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.439296 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.439867 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.440175 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.440442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.441137 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.442729 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.453141 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1431/2858] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:24.457347 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.467579 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001ebc-89f0-4178-a9f7-8f840d7b4136 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.473203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.473849 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.474128 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.474396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.475043 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.476659 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384e8e3-9f01-4309-95cf-80f4dcf6ec3e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.487743 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1428/2859] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:24.492290 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.503075 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e38fd-fffe-4c99-83a8-e5985ce7d41f admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.508052 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.508711 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.509004 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.509312 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] PATH_INFO: `/v3/projects/020b7c97b5844ac08bc0d7744d04faf1/users/70890eff04c647aea642247cec813d64/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.524042 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020b7c97b5844ac08bc0d7744d04faf1, user_id=70890eff04c647aea642247cec813d64, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.526779 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.540858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1432/2860] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:24 2022] PUT /identity/v3/projects/020b7c97b5844ac08bc0d7744d04faf1/users/70890eff04c647aea642247cec813d64/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:24.546171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.546443 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.546797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.566693 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:24.567893 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:24.587751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:24.637013 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1429/2861] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:24.647350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.649275 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:24.710102 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba161-378d-45c9-bbd6-a5f6521dfe65 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.714614 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.715225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.715505 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.715780 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.725428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.726870 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883be080-790f-4aec-8df0-543ed6157968 service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.736680 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1433/2862] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:24.850736 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:24.852529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:24.866315 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f8628-7262-4538-9288-8e32f28c8f67 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:24.872218 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:24.872943 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.873328 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.873569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] PATH_INFO: `/v3/users/b2dcd1f98f7940f4b153400ff26450e0` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.875019 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dcd1f98f7940f4b153400ff26450e0)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:24.876999 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:24.930913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dcd1f98f7940f4b153400ff26450e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.946020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dcd1f98f7940f4b153400ff26450e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.954052 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dcd1f98f7940f4b153400ff26450e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.954923 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dcd1f98f7940f4b153400ff26450e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.955960 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dcd1f98f7940f4b153400ff26450e0'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:24.972378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1430/2863] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:24 2022] DELETE /identity/v3/users/b2dcd1f98f7940f4b153400ff26450e0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:24.977302 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350f01-aa66-429b-aa3f-5c21e52b6b30 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:24.977590 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350f01-aa66-429b-aa3f-5c21e52b6b30 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:24.977864 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350f01-aa66-429b-aa3f-5c21e52b6b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:24.997105 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e1350f01-aa66-429b-aa3f-5c21e52b6b30 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:24.998316 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e1350f01-aa66-429b-aa3f-5c21e52b6b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.077074 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1434/2864] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:25.089130 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.090577 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.155382 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d897e4-08b3-4e0e-8f1d-901e29b9bab2 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.159239 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.159961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.160329 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.160694 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.170415 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.172065 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.181876 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1431/2865] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:25.503288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.503288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.503288 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.534642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] MFA Rules not processed for user `70890eff04c647aea642247cec813d64`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:25.535348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.549545 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:25.605432 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.607584 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.628212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1435/2866] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:25.632276 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dc344-1d57-48c2-b817-d2db87f57959 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.636149 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.637267 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.637954 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.638235 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.638507 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] PATH_INFO: `/v3/projects/7d683d400f834a0eb45dbf33f8eb8ae3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.638809 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.639661 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d683d400f834a0eb45dbf33f8eb8ae3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.641720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.690649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:25.706020 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d683d400f834a0eb45dbf33f8eb8ae3', 'request_id': 'req-146af554-8173-4871-a8e6-5c628349a22e'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.709848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd882b0-46ff-4f5f-a0b5-b117e0e58b17 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.715417 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d683d400f834a0eb45dbf33f8eb8ae3', 'request_id': 'req-146af554-8173-4871-a8e6-5c628349a22e'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.723337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d683d400f834a0eb45dbf33f8eb8ae3', 'request_id': 'req-146af554-8173-4871-a8e6-5c628349a22e'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.742142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] The token cache is being invalidate because project 7d683d400f834a0eb45dbf33f8eb8ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:25.742498 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.743107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-146af554-8173-4871-a8e6-5c628349a22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.745351 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1432/2867] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:25 2022] DELETE /identity/v3/projects/7d683d400f834a0eb45dbf33f8eb8ae3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:25.750479 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851ee9-cc60-4693-8692-e4c79c0abc2a None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.750775 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851ee9-cc60-4693-8692-e4c79c0abc2a None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.751038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851ee9-cc60-4693-8692-e4c79c0abc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.770750 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.771662 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.771785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-a1851ee9-cc60-4693-8692-e4c79c0abc2a None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:25.772333 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.772731 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.772921 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-a1851ee9-cc60-4693-8692-e4c79c0abc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.774971 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.840381 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1433/2868] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:25.848564 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.848858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.849167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.849589 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.851195 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.862006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1436/2869] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:25.870720 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:25.871924 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.880395 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1434/2870] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:25.884887 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.896007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa2602-4077-4a74-a32c-c20bc1cc2c5b service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.900989 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.901621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.901899 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.902197 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] PATH_INFO: `/v3/domains` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.902875 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:25.903174 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.904757 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.917009 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1437/2871] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:25.921038 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.930858 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8327d-0835-4720-b2e2-b0bad37ecbfa None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.935852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.936771 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.937211 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.937558 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.938294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.940293 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.971790 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1435/2872] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:25.973051 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.983362 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63c140-0900-4055-8a21-fa262c5606bd admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.994212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:26.049297 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.049919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.050225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.050498 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.051144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.053109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.081003 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1438/2873] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:26.082688 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.093484 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296933e-619c-4160-b5c9-f049acb08c12 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.098205 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.098819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.099096 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.099368 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.100014 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.101669 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.115913 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1436/2874] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:26.117572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.129470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779169da-14e7-453b-b841-af58f13d4664 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.135567 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.136216 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.136496 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.136767 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.137482 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.139111 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c63908-606d-443a-8a9b-540c558287d1 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.151962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1439/2875] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:26.156094 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.166367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4be5ab-51c2-42f0-b8a2-346a17d84bfc admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.173812 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.174470 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.174756 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.175033 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] PATH_INFO: `/v3/projects/ce8efb6a3bd84a5e96f72011b7df3c83/users/9da421fb1c99463881ad183538b9a031/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.191641 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8efb6a3bd84a5e96f72011b7df3c83, user_id=9da421fb1c99463881ad183538b9a031, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.194538 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.211378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1437/2876] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:26 2022] PUT /identity/v3/projects/ce8efb6a3bd84a5e96f72011b7df3c83/users/9da421fb1c99463881ad183538b9a031/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:26.221984 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.222212 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.222486 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.249985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] MFA Rules not processed for user `9da421fb1c99463881ad183538b9a031`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:26.251178 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:26.323035 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1440/2877] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:26.328010 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.402032 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810690-3900-4d82-87af-436482cf5ae8 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.408607 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.409378 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.409801 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.410051 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.410972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.413410 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.419337 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:26.446282 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1438/2878] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:26.450548 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.465781 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ecdf-c9c0-40a4-96f9-18ad5571cc06 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.526360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.527185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.527185 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.527488 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.528118 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.530071 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.553170 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1441/2879] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:26.557123 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.568039 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb59b1-d122-4f45-b651-17993ebb5ed2 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.573363 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.573974 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.574256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.574530 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.575177 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.576789 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.587597 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1439/2880] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:26.591794 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.602104 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fbc85-29bd-48ed-8a78-b8bc286077a5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.607687 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.608329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.609083 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.609375 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.610024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.611612 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711b261-1fcb-4f62-9f70-3289c09e9ff7 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.616907 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:26.626944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1442/2881] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:26.627945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.638648 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1e5b-6a05-43b1-a1e5-f7050402c9cd admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.644396 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.645085 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] REQUEST_METHOD: `PUT` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.645369 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.645639 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] PATH_INFO: `/v3/projects/4ae583438e514756b92c0d2e704f4f22/users/5fa567e2b0f54c70b835a9e6e7de5ea3/roles/4f141bfba90347c9bd6a2851ea2e615c` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.661915 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae583438e514756b92c0d2e704f4f22, user_id=5fa567e2b0f54c70b835a9e6e7de5ea3, role_id=4f141bfba90347c9bd6a2851ea2e615c)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.664551 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.684751 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1440/2882] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:26 2022] PUT /identity/v3/projects/4ae583438e514756b92c0d2e704f4f22/users/5fa567e2b0f54c70b835a9e6e7de5ea3/roles/4f141bfba90347c9bd6a2851ea2e615c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:26.696817 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.697133 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.697405 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.727695 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] MFA Rules not processed for user `5fa567e2b0f54c70b835a9e6e7de5ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:26.728911 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:26.797676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1443/2883] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:26.802493 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.867287 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8924-c5ee-4534-bcb3-2e9427732402 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.876248 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.877118 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.877435 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.877827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.878738 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.881671 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.920366 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1441/2884] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:26.924766 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.935678 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fd81b-36f3-4826-bf0b-f516826cb34a None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.993629 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.994229 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.994509 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.994775 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] PATH_INFO: `/v3/users` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.995401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.997330 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.022367 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1444/2885] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:26 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:27.027250 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.038257 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e66-975c-43b4-9f94-fbec8aca7ea2 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.046992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.047618 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.047972 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.048209 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.048863 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.050503 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.061649 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1442/2886] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:27.065917 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.075863 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e093aa-10e3-41d9-8ad8-5e849c398db5 admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.080738 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.081420 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.081696 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.081963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] PATH_INFO: `/v3/projects/33d3a9367506472a89cc781e5f7cd6e5/users/d0f90c472df344bda1bd3b9f4082a425/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.097850 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d3a9367506472a89cc781e5f7cd6e5, user_id=d0f90c472df344bda1bd3b9f4082a425, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.100476 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.116239 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1445/2887] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:27 2022] PUT /identity/v3/projects/33d3a9367506472a89cc781e5f7cd6e5/users/d0f90c472df344bda1bd3b9f4082a425/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:27.120373 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.131572 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3276c3b-9cef-4614-b2f8-a012bf8fd91d admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.192058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.192815 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.193132 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.193422 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] PATH_INFO: `/v3/roles` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.194067 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.195696 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210952-f272-45eb-893a-7d9d318125af admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.206527 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1443/2888] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:27.210882 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.221587 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542def21-d7c5-4927-a204-7fef208011ce admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.226384 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.227047 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] REQUEST_METHOD: `PUT` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.227329 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.227604 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] PATH_INFO: `/v3/projects/33d3a9367506472a89cc781e5f7cd6e5/users/d0f90c472df344bda1bd3b9f4082a425/roles/5d0ba9933aef4ff28eb619a010b578b5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.229528 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d3a9367506472a89cc781e5f7cd6e5, user_id=d0f90c472df344bda1bd3b9f4082a425, role_id=5d0ba9933aef4ff28eb619a010b578b5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.232151 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114deba4-431d-443c-a273-1262b8e978ee admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.242834 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.243122 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.243399 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.243608 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1446/2889] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:27 2022] PUT /identity/v3/projects/33d3a9367506472a89cc781e5f7cd6e5/users/d0f90c472df344bda1bd3b9f4082a425/roles/5d0ba9933aef4ff28eb619a010b578b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:27.255144 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.255428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.255668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.267197 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] MFA Rules not processed for user `70890eff04c647aea642247cec813d64`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:27.268467 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.281490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:27.283988 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] MFA Rules not processed for user `d0f90c472df344bda1bd3b9f4082a425`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:27.285269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.314964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:27.326388 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1444/2890] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:27.362723 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1447/2891] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:27.370261 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.370730 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.372003 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.372147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.431772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fcf6a-83da-49a9-a6d3-33170587007f None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.432915 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757a053-ac3e-4c00-bc74-2959eecabb82 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.435487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab5524ecd44403bb82fd4d6433fb002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.436107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.436387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.436658 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.437675 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.438657 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.438865 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.439253 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.439681 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.502258 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.503736 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.512913 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1448/2892] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:27.524842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.526447 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.538008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1445/2893] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:28.091566 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:28.093278 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:28.158359 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26497e-ae45-41be-a90f-14c0fe320afb service cinder] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.161992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.162605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.162885 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.163159 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.164937 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:28.179245 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.180802 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.193188 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1449/2894] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:29.045008 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:29.046749 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:29.058353 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab424cb-4e3f-4315-b49b-e031256d40dc service glance] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:29.062819 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:29.063425 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:29.063702 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:29.064002 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:29.125942 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:29.127563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:29.137713 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1446/2895] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:29.734838 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:29.744439 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6427b-82f7-44ac-aabf-b02a328f2f5a service neutron] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:29.748519 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea417bef9414609b3c79bbf2cc2ced2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:29.749163 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:29.749500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:29.749774 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:29.759418 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:29.760995 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709ee8-1784-4f0b-baf8-543f29edf78a service cinder] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:29.771866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1450/2896] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:33.743673 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:33.749728 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=100 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:33.814842 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d35cc-3007-4834-90d5-4c78eb5e019c service cinder] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:33.819722 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:33.820345 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:33.820590 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:33.820875 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] PATH_INFO: `/v3/users/9da421fb1c99463881ad183538b9a031` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:33.822022 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da421fb1c99463881ad183538b9a031)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:33.823940 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:33.873313 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da421fb1c99463881ad183538b9a031'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:33.885797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da421fb1c99463881ad183538b9a031'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:33.893844 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da421fb1c99463881ad183538b9a031'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:33.894596 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da421fb1c99463881ad183538b9a031'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:33.895294 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da421fb1c99463881ad183538b9a031'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:33.910687 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1447/2897] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:33 2022] DELETE /identity/v3/users/9da421fb1c99463881ad183538b9a031 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:33.915365 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:33.915862 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:33.915962 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:33.936280 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:33.937560 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:33.943201 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=100 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:34.010401 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1451/2898] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:34.020433 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:34.022262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:34.085750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242585a1-3013-4140-b406-3e5d6af89278 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:34.089796 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:34.090500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:34.090841 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:34.091185 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:34.101230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:34.102810 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:34.112588 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1448/2899] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:34.406603 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:34.408568 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:34.422191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb942c-6149-4f3a-8d0c-a803444a4570 None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:34.427243 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:34.427884 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:34.428164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:34.428438 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] PATH_INFO: `/v3/projects/ce8efb6a3bd84a5e96f72011b7df3c83` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:34.429580 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8efb6a3bd84a5e96f72011b7df3c83)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:34.431514 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:34.495572 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8efb6a3bd84a5e96f72011b7df3c83', 'request_id': 'req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.501676 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8efb6a3bd84a5e96f72011b7df3c83', 'request_id': 'req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.510586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8efb6a3bd84a5e96f72011b7df3c83', 'request_id': 'req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.523062 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] The token cache is being invalidate because project ce8efb6a3bd84a5e96f72011b7df3c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:34.523303 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.523979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.525554 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1452/2900] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:34 2022] DELETE /identity/v3/projects/ce8efb6a3bd84a5e96f72011b7df3c83 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:34.529610 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:34.539367 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ddbf-28be-4db9-9bed-54a9c783db72 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:34.563194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:34.602712 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:34.603352 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:34.603633 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:34.603906 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] PATH_INFO: `/v3/users/5fa567e2b0f54c70b835a9e6e7de5ea3` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:34.605095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa567e2b0f54c70b835a9e6e7de5ea3)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:34.607107 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:34.658072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa567e2b0f54c70b835a9e6e7de5ea3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.672705 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa567e2b0f54c70b835a9e6e7de5ea3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.680230 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa567e2b0f54c70b835a9e6e7de5ea3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.681148 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa567e2b0f54c70b835a9e6e7de5ea3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.681764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa567e2b0f54c70b835a9e6e7de5ea3'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:34.697827 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1449/2901] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:34 2022] DELETE /identity/v3/users/5fa567e2b0f54c70b835a9e6e7de5ea3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:34.973470 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:34.975093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:34.990699 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8783ad6-03a5-434b-9761-a39f6bd5cf1d admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:35.053682 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:35.054248 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:35.054531 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:35.054810 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] PATH_INFO: `/v3/projects/4ae583438e514756b92c0d2e704f4f22` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:35.055934 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae583438e514756b92c0d2e704f4f22)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:35.057898 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:35.101347 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:35.112225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae583438e514756b92c0d2e704f4f22', 'request_id': 'req-2ab09adc-b051-4be5-b7cf-82f7de472eff'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.119904 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae583438e514756b92c0d2e704f4f22', 'request_id': 'req-2ab09adc-b051-4be5-b7cf-82f7de472eff'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.131025 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae583438e514756b92c0d2e704f4f22', 'request_id': 'req-2ab09adc-b051-4be5-b7cf-82f7de472eff'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.142557 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] The token cache is being invalidate because project 4ae583438e514756b92c0d2e704f4f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:35.142848 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.143507 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.145147 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1453/2902] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:34 2022] DELETE /identity/v3/projects/4ae583438e514756b92c0d2e704f4f22 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:35.149401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:35.150835 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:35.164163 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cac4-13a9-44da-9929-1d7c15ae9a31 admin admin] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:35.230567 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:35.231204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:35.231481 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:35.231754 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] PATH_INFO: `/v3/users/d0f90c472df344bda1bd3b9f4082a425` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:35.232886 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f90c472df344bda1bd3b9f4082a425)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:35.234874 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:35.288004 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f90c472df344bda1bd3b9f4082a425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.289134 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:35.303072 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f90c472df344bda1bd3b9f4082a425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.310323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f90c472df344bda1bd3b9f4082a425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.311055 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f90c472df344bda1bd3b9f4082a425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.311698 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-62321259-5bd7-4b0f-80b8-ccdedbac8cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f90c472df344bda1bd3b9f4082a425'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.328271 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1450/2903] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:35 2022] DELETE /identity/v3/users/d0f90c472df344bda1bd3b9f4082a425 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:35.603249 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:35.604888 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:35.620168 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09adc-b051-4be5-b7cf-82f7de472eff admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:35.686955 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:35.687597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:35.687876 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:35.688156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] PATH_INFO: `/v3/projects/33d3a9367506472a89cc781e5f7cd6e5` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:35.689484 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d3a9367506472a89cc781e5f7cd6e5)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:35.691428 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:35.745906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d3a9367506472a89cc781e5f7cd6e5', 'request_id': 'req-fcd80f34-7d59-472f-9db1-09955b119bec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.753277 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d3a9367506472a89cc781e5f7cd6e5', 'request_id': 'req-fcd80f34-7d59-472f-9db1-09955b119bec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.763206 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d3a9367506472a89cc781e5f7cd6e5', 'request_id': 'req-fcd80f34-7d59-472f-9db1-09955b119bec'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.774358 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] The token cache is being invalidate because project 33d3a9367506472a89cc781e5f7cd6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:35.774648 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.775283 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:35.776752 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1454/2904] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:35 2022] DELETE /identity/v3/projects/33d3a9367506472a89cc781e5f7cd6e5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:45.324902 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:45.771573 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:53.034640 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280017d-610b-425a-ae56-a756c7f90146 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.035539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280017d-610b-425a-ae56-a756c7f90146 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.035539 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280017d-610b-425a-ae56-a756c7f90146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.064797 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-f280017d-610b-425a-ae56-a756c7f90146 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:53.066026 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-f280017d-610b-425a-ae56-a756c7f90146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.127242 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1451/2905] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:53.150373 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:53.151878 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.227221 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd80f34-7d59-472f-9db1-09955b119bec admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:53.233200 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:53.233805 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.234080 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.234351 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.242708 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:53.244363 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:53.254360 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1455/2906] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:56.105986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556722a0-9f63-4c8d-87b5-285cc088d860 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:56.106529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556722a0-9f63-4c8d-87b5-285cc088d860 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:56.106529 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556722a0-9f63-4c8d-87b5-285cc088d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:56.125971 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-556722a0-9f63-4c8d-87b5-285cc088d860 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:56.127162 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-556722a0-9f63-4c8d-87b5-285cc088d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:56.137711 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1452/2907] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:56.152451 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:56.154018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:56.169160 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decd58d-548b-481c-ba55-40cc8f85564c service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:56.175018 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:56.175617 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:56.175894 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:56.176164 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:56.184254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:56.185866 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:56.195162 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1456/2908] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:59.407203 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa094f9-dd85-4c18-aabf-8f78fd4e6ae6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:59.407755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa094f9-dd85-4c18-aabf-8f78fd4e6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:59.407755 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa094f9-dd85-4c18-aabf-8f78fd4e6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:59.429243 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-5fa094f9-dd85-4c18-aabf-8f78fd4e6ae6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:59.430468 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-5fa094f9-dd85-4c18-aabf-8f78fd4e6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:59.440219 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1453/2909] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:59.456940 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:59.468701 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d05ea2-4d3f-4abd-a3ec-87c646eed6c5 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:59.474627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:59.475228 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:59.475504 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:59.475777 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:59.484586 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:59.486247 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:59.496618 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1457/2910] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:02.524074 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c601be-d99f-4304-a81f-02724eca076c None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:02.524569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c601be-d99f-4304-a81f-02724eca076c None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:02.524569 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c601be-d99f-4304-a81f-02724eca076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:02.545905 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-20c601be-d99f-4304-a81f-02724eca076c None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:02.547095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-20c601be-d99f-4304-a81f-02724eca076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:02.557058 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1454/2911] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:02.572836 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:02.586964 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202234e4-e825-46b1-8bd4-638d74947c40 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:02.593944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:02.594642 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:02.594969 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:02.595240 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:02.603679 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:02.605300 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:02.615325 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1458/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:05.720772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2eb0-4560-4396-be33-70ed16e9a31d None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.721323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2eb0-4560-4396-be33-70ed16e9a31d None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.721323 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2eb0-4560-4396-be33-70ed16e9a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.741989 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-0d3f2eb0-4560-4396-be33-70ed16e9a31d None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:05.743256 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-0d3f2eb0-4560-4396-be33-70ed16e9a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:05.752867 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1455/2913] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:05.770136 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:05.782067 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1bba-182d-43ea-9f68-cd60b5fa48b5 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.788987 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.789627 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.789906 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.790177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.798331 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:05.799914 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:05.809851 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1459/2914] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:08.912813 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:08.913387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:08.913387 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:08.934945 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:08.936140 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:08.948044 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1456/2915] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:08.964556 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:08.976205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99635-609f-439b-afe3-f3b2f4335879 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:08.982852 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:08.983419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:08.983714 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:08.983979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:08.992250 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:08.993858 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2e163-1cd1-463f-82e3-c661d0d2252a service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:09.003150 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1460/2916] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:18.929263 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=42 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:18.999171 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=64 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:20.517785 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:20.530764 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d1a1b-a598-40e5-8733-12589f860fc6 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:20.536344 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:20.536992 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:20.537262 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:20.537533 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:20.539371 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:20.553846 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:20.555500 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:20.567526 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1457/2917] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:25.405121 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] REQUEST_METHOD: `POST` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:25.405665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:25.405665 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:25.425798 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.auth.core [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] MFA Rules not processed for user `70890eff04c647aea642247cec813d64`. Rule list: `[]` (Enabled: `True`). {{(pid=93190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:25.426992 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:25.484348 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1461/2918] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:25.726949 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:25.729171 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:25.796523 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc54c-5739-42b1-9b4d-ee7a0be3c0b6 service nova] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:25.800852 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:25.801474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:25.801744 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:25.802015 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:25.804145 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:25.813961 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:25.815383 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:25.825766 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1458/2919] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:26.166323 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:26.172109 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:26.243101 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6838a2-bde8-40f7-99f2-0a8f7e9deb4f None None] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:26.248037 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:26.248645 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:26.248919 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:26.249289 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:26.251034 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:26.262099 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:26.263667 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:26.274218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1462/2920] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:27.955068 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:27.956948 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:27.968041 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74309c-0ece-4746-b5e6-1486469e7f31 service neutron] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:27.972095 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1015e2218b14b85aba318460f6deb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:27.972691 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:27.973025 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:27.973274 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:27.975452 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:27.985837 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:27.987279 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc92db6-79b5-4e15-83f7-edbbeb6752a6 service neutron] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:27.995637 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1459/2921] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:32.611770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.625865 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dada2-70a0-404d-a404-7e05a50cd120 service placement] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.632582 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.633225 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.633500 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.633770 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.635703 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:32.648912 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.650530 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.661831 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1463/2922] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:36.270574 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2939e-2f42-4f0a-9488-da3df4e0192b None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:36.271195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2939e-2f42-4f0a-9488-da3df4e0192b None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:36.271195 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2939e-2f42-4f0a-9488-da3df4e0192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:36.291965 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-25f2939e-2f42-4f0a-9488-da3df4e0192b None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:36.293142 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-25f2939e-2f42-4f0a-9488-da3df4e0192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:36.302285 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1460/2923] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:36.321255 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:36.334205 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bf577-0b4d-47e3-9abe-85fa8420a0af service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:36.340534 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:36.341177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:36.341459 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:36.341732 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:36.349949 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:36.351540 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:36.362100 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1464/2924] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:39.596036 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a83ae-4535-4230-b5ba-12dcf0f39ff2 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:39.596613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a83ae-4535-4230-b5ba-12dcf0f39ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:39.596613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a83ae-4535-4230-b5ba-12dcf0f39ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:39.616919 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-942a83ae-4535-4230-b5ba-12dcf0f39ff2 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:39.618149 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-942a83ae-4535-4230-b5ba-12dcf0f39ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:39.627143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1461/2925] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:00:39.643668 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:39.655079 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008a7f-e00b-409f-954f-a34ca8ca6049 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:39.661072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a596b-b40e-476b-8704-334df6538376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:39.661672 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a596b-b40e-476b-8704-334df6538376 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:39.661976 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a596b-b40e-476b-8704-334df6538376 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:39.662244 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a596b-b40e-476b-8704-334df6538376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:39.670953 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a596b-b40e-476b-8704-334df6538376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:39.672533 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a596b-b40e-476b-8704-334df6538376 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:39.682091 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1465/2926] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:42.675575 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaff10-872b-48c9-8ba7-0a272e3137ce None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:42.676087 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaff10-872b-48c9-8ba7-0a272e3137ce None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:42.676194 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaff10-872b-48c9-8ba7-0a272e3137ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:42.696894 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-fdcaff10-872b-48c9-8ba7-0a272e3137ce None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:42.698143 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-fdcaff10-872b-48c9-8ba7-0a272e3137ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:42.707340 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1462/2927] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:42.723056 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a596b-b40e-476b-8704-334df6538376 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:42.734646 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a596b-b40e-476b-8704-334df6538376 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:42.740647 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:42.741269 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:42.741551 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:42.741825 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:42.750072 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:42.751597 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:42.761156 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1466/2928] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:45.847406 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9377-08c2-4500-8352-d93d6fe3e703 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:45.848204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9377-08c2-4500-8352-d93d6fe3e703 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:45.848204 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9377-08c2-4500-8352-d93d6fe3e703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:45.871390 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-e9ea9377-08c2-4500-8352-d93d6fe3e703 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:45.872613 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-e9ea9377-08c2-4500-8352-d93d6fe3e703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:45.882488 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1463/2929] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:45.899267 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:45.911177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2a516-a84b-429c-855b-5b8274cc7fb2 service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:45.917093 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:45.917700 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:45.917978 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:45.918231 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:45.927191 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:45.928793 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:45.939076 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1467/2930] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:49.043979 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] REQUEST_METHOD: `POST` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:49.044490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:49.044490 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:49.055385 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=51 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.069078 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.auth.core [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] MFA Rules not processed for user `362c24be2bf7418da80780e268b3a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:49.070299 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:49.079839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1464/2931] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:49.096177 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:49.102502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=88 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.109218 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9c3a0-f031-46ff-a07b-45c1087a925c service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:49.115783 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f86708703f4f86953e188c3bac4c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:49.116389 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:49.116670 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:49.116944 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:49.125755 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:49.127372 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:49.137613 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1468/2932] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:59.065236 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=2 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:59.132997 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=5 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:17.396167 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:17.408651 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ebb4-4f8a-471b-ab1e-3cee0db70a19 None None] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:17.414175 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:17.414772 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] REQUEST_METHOD: `GET` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:17.415275 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:17.415546 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:17.417489 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.fernet_utils [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:17.429586 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:17.431245 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:17.442339 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1465/2933] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:17.449502 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:17.451061 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:17.465834 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a540f-f7c7-4b5c-8212-d5ea20fccb5d service nova] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:17.470621 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:17.471266 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:17.471546 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:17.471818 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] PATH_INFO: `/v3/users/70890eff04c647aea642247cec813d64` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:17.472941 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=70890eff04c647aea642247cec813d64)` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:17.475038 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:17.526442 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70890eff04c647aea642247cec813d64'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.534985 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70890eff04c647aea642247cec813d64'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.542419 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70890eff04c647aea642247cec813d64'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.543044 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70890eff04c647aea642247cec813d64'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.554622 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.notifications [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70890eff04c647aea642247cec813d64'} {{(pid=93190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.560979 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1469/2934] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 12:01:17 2022] DELETE /identity/v3/users/70890eff04c647aea642247cec813d64 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:01:17.737770 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] Authenticating user token {{(pid=93191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:17.752563 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3861-11d5-49a1-bc31-1f455f2f8cdc service placement] Validating token access rules against request {{(pid=93191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:17.813839 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c24be2bf7418da80780e268b3a2f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b3b177b7bdd47fbbe8d53653a263794', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:17.814474 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:17.814750 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:17.815007 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] PATH_INFO: `/v3/projects/020b7c97b5844ac08bc0d7744d04faf1` {{(pid=93191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:17.816129 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020b7c97b5844ac08bc0d7744d04faf1)` {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:17.818089 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] RBAC: Authorization granted {{(pid=93191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:17.868212 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020b7c97b5844ac08bc0d7744d04faf1', 'request_id': 'req-77e569db-b9f8-4cd9-a59f-01a28c161e70'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.874431 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020b7c97b5844ac08bc0d7744d04faf1', 'request_id': 'req-77e569db-b9f8-4cd9-a59f-01a28c161e70'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.879986 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020b7c97b5844ac08bc0d7744d04faf1', 'request_id': 'req-77e569db-b9f8-4cd9-a59f-01a28c161e70'} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.894199 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] The token cache is being invalidate because project 020b7c97b5844ac08bc0d7744d04faf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:01:17.894487 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.895101 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG keystone.notifications [None req-77e569db-b9f8-4cd9-a59f-01a28c161e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:01:17.896615 dv-cinder-852208-12-smb devstack@keystone.service[93191]: [pid: 93191|app: 0|req: 1466/2935] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 12:01:17 2022] DELETE /identity/v3/projects/020b7c97b5844ac08bc0d7744d04faf1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:01:27.557081 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:27.891401 dv-cinder-852208-12-smb devstack@keystone.service[93191]: DEBUG dbcounter [-] [93191] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:34.417787 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Authenticating user token {{(pid=93190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:34.419455 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:34.493024 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528a2a-d3b7-40b1-9e0d-f0b35abbbfef admin admin] Validating token access rules against request {{(pid=93190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:34.557113 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34fbf3ab49044968bff90c32f730c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3159ebcbe4314d298e16f887e288ddff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:34.557636 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] REQUEST_METHOD: `GET` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.557963 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] SCRIPT_NAME: `/identity` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.558254 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.560605 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.fernet_utils [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:34.576007 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:34.578350 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8f1dc-4156-4eeb-a32b-b122d2f7c003 service placement] RBAC: Authorization granted {{(pid=93190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:34.592521 dv-cinder-852208-12-smb devstack@keystone.service[93190]: [pid: 93190|app: 0|req: 1470/2936] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:44.587006 dv-cinder-852208-12-smb devstack@keystone.service[93190]: DEBUG dbcounter [-] [93190] Writing DB stats keystone:SELECT=58 {{(pid=93190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}